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ABSTRACT 

Four Proficiency Examinations for Clinical Laboratory 
Personnel were developed in clinical Chemistry, Microbiology » 
Hematology, and Blood Banking. Purpose of project was to enable 
competent military laboratory technicians who lack credentials to 
demonstrate their job-related skills and knowledge for civilian 
positions, and also to help civilians trained on the job to advance. 
The examinations were constructed by laboratory experts and 
administered to more than 4,000 persons. Hormative data have been 
compiled. Test scores are used by employers to place and promote 
laboratory workers. Some credentialing agencies are using or 
considering use of the examinations. Special use of the tests, 
including evaluating needs for continuing education, are being 
developed. The examinations have paved the way for development of 
equivalency examinations for academic credit, and for other 
proficiency examinations in nearly all allied health fields. Future 
needs include updating the examinations to meet rapid changes in the 
field, publicizing future administration of t' e examinations, and a 
study to compare job performance with test scores to prove the 
job-relationship of the examinations under mandates of equal 
employment opportunity regulations. (Author) 
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The National Committee for Careers In the Medical Laboratory, spon- 
sored by the American Society of Clinical Pathologists and the College 
of American Pathologists, was founded in 1953 to promote recruitment 
and strengthen educational programs for medical laboratory personnel. 
The Committee has carried out an extensive program of research studies 
and demonstration projects, production of printed and audio*visual 
materials, and development of recruitment and scholarship programs. 

The Committee's work in recent years has focused on career mobility in 
the laboratory field, including: a 1967 conference on "Manpower for 
the Medical Laboratory," bringing together persons from government 
and the professions to consider problems of recruitment, education, 
and utilization of laboratory personnel; publication of "Equivalency 
and Proficiency Testing Related to the Medical Laboratory Field"; 
development of Proficiency Examinations for job placement; promo* 
tlon of Equivalency Examinations for academic credit; and preparation 
and utilization of audio-visual materials for training and upgrading. 
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The National Committee for Careers in the Medical Laboratory and 
this Proficiency Examinations Project owe much to Thomas M. Peery, 
M.Dm who in his 1969 address as President of the American Society of 
Clinical Pathologists advanced the idea of a true career ladder for clin- 
ical laboratory personnel, and who as NCCML*s Chairman from 1970 
through 1973 led the Committee*s efforts to achieve this goal^ 
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Highlights 



• Four Proficiency Examinations for Clinical Laboratory Personnel - in 
Clinical Chemistry, Microbiology, Hematology, and Blood Banking - 
have been developed by the National Committee for Careers in the 
Medical Laboratory, working with Educational Testing Service, under a 
contract with the Manpower Administration of the Department of 
Labor. 

• Purpose of the project was to break down barriers to employment and 
upgrading of competent medical laboratory technicians who lack cre- 
dentials, by enabling them to demonstrate their job-related skills and 
knowledge. Both military laboratory specialists seeking civilian labora- 
tory careers and civilians trained on the job who seek advancement can 
benefit. 

• The Proficiency Examinations were constructed by laboratory experts 
and are now administered on a regular basis by Educational Testmg 
Service at test centers across the country and military bases throughout 
the world. More than 4,000 laboratory workers have taken them. 

• Normative data have been compiled showing the scores of a representa- 
tive group of hundreds of laboratory technicians who have taken the 
Examinations. 

• Test scores are being used by employers to place and promote labora- 
tory workers. By enabling employers to hire ex-corpsmen, for example, 
at bett(!r than entry level, the Examinations help retaui trained and 
experienced workers for the laboratory field. 

• Some credentialing agencies are using or considering use of the Exami- 
nations. Special use of the tests, including evaluating needs for con- 
tinuing education, are being developed. 

• A companion set of Equivalency Examinations for academic credit in 
the same four laboratory areas has been developed concurrently with 
the Proficiency Examinations by Educational Testing Service, and has 
been promoted by NCCML. 

• The Examinations have paved the way for development of other pro- 
ficiency examinations in nearly all the allied health fields. Such projects 
are now underway in the Department of HeaUh, Education, and Wel- 
fare, mandated by Congress in P.L. 92-603. 
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Background 



Many factors converged to prompt the undertaking 
of this project by the National Committee for Careers in 
the Medical Laboratory, the Educational Testing Service, 
and the Manpower Administration in July of 1970: 

• Projected shortages of medical laboratory per* 
sonnel stemming from greater demwds for 
laboratory services as the result of population 
increases, new technologies, and greater utilization 
of medical care facilities through Medicare, 
Medicaid and health insurance coverage. 

^ The need for a mechanism to measure the abilities 
of uncredentialed medical laboratory workers who 
have learned on the job or in unaccredited training 
programs, to qualify them for work on Medicare 
and other assignments. 

• Federal government interest in facilitating transfer 
of military*trained health manpower to the civilian 
health field, so as not to lose the value of their 
training and experience. 

• Readiness of the medical laboratory field for 
development of proflciency examinations, ds 
recommended at the National Conference on 
Manpower for the Medical Laboratory in 1967 
and in the study of "Equivalency and Proficiency 
Testing Related to the Medical Laboratory Field'* 
completed early in 1970, and affirmed by path* 
ologists at a 1970 meeting called by HEW to 
discuss barriers to utilization of laboratory 
workers. 

• The opportunity for tandem development of 
proficiency examinations at the same time as a 
project for equivalency examinations was begun 
for the HEW Division of Allied Health Manpower. 

Shortages 

In the decade frcm 1965 to 1975, according to a 
Labor Department estimate, an increase from 100,000 
to 160,000 medical laboratory workers would be 



required just to keep up with laboratory tests being done 
at the beginnhig of that period. The Public Health 
Service projected similar needs. The Tennessee Hospital 
Association said in January 1970 their survey indicated 
the need for laboratory technicians would more than 
triple in the next three years. 

Certifiable laboratory education falls far short of 
filling the nation's needs. Even if they were full to 
capacity, the schools could barely keep up with normal 
attrition, let alone meet the projected need. 

Improving Utilization 

Leaders in the medical laboratory field recognized 
that better use of workers already employed would be at 
least part of the solution to the impending manpower 
shortage. Better utilization would entail establishing a 
career ladder anH making available new opportunities for 
upward mobility through recognition of knoivledge and 
skills gained outside of formal education. 

Among the under-utilized: (1) the 1,700 military- 
trained laboratory specialists being separated from the 
Armed Forces each year, the majority of whom did not 
transfer their training and skills to the civilian laboratory 
field, and (2) the many thousands of lower-level civilian 
employees, most of them trained on the job, with no 
officially-recognized certification or status in the field, 
regardless of their actual qualifications. But there was no 
way to evaluate the real qualifications of e^^her group. 

The National Committee for Careers i:i the Medical 
Laboratory* was well aware of the needs ; nd problems 
in the field. In 1967, the Committee had sponsored with 
the Public Health Service a conference on "Manpower 
for the Medical Laboratory," bringing together repre- 
sentatives of government and the professions to consider 



"^Until Pall 19* 0, the National Committee for Careers in Medical 
Technology, kcference in this report is to NCCML, for tiie sake 
of simplicity. 
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• Specific efforts should be aimed 
at recruiting armed service veterans who 
received training in military laboratory 
programs .... Low salaries and lack of 
prestige at the levels for which they 
qualified have deterred veterans from 
seekmg civilian laboratory jobs .... 

• . . . The recognition of knowledge 
gained outside of formal education to fulfill 
academic and clinical requirements would 
give persons with initiative and ability 
opportunities for advancement. 
-Recommendations, Conference on 
Manpower for the Medical 
Laboratory 0967) 



problems of recruitment, education and utilization of 
medical laboratory personnel. The conference recom- 
mended the recruitment of military-trained laboratory 
specialists for civilian jobs, and noted that recognition of 
knowledge gained outside of formal education **woula 
give fiersons with initiative and ability opportunities for 
advancement.** It suggested that examinations should be 
developed to provide increased mobility between levels 
and categories of laboratory careers. 

Equivalency and Proficiency Tests 

Following up on the conference recommendation, 
NCCML initiated with the support of the HEW Division 
of Allied Health Manpower a year-long study of the 
"state of the art** of equivalency and proftciency testing 
- and its possible uses in the medical laboratory field. 
The report of that study, "Equivalency and Proficiency 
Testing Related to the Medical Laboratory Field,** issued 
in March 1970, defined terms, summarized current 
testing practices in the allied health fields, and identified 
a need and considerable support for development of 
tests to evaluate the skills and knowledge of laboratory 
workers. 

Equivalency examinations, the report noted, are 
designed to provide academic credit for off-campus 
learning. At the time of the study, the College-Level 
Examination Program (CLEP) of the College Entrance 
Examination Board was beginning to offer a national 
credit-by^examination opportunity, following the lines 
of a new examination program offered by the State of 
New York. An idea begun by the University of Illinois in 
1895, and fostered by many individual colleges, was 
becoming a national movement, providing a way for 



persons to demonstrate learning achieved throu^ means 
other than on-campus courses. 

Proficiency examinations'*" measure the skills and 
knowledge necessary to perform at a certain job level - 
an assessment of job capabilities. The study found that 
historically there had been very little activity in this 
area, although considerable interest was developing. 

Federal Pressures 

T he NCCML study came to the attention of Congress. 
The House Ways and Means Committee was then looking 
into Medicare's personnel standards for independent 
laboratories. Concluding that a heavy reliance on 
certification by professional organizations *'has served to 
prevent experienced people either from entering the 
clinical laboratory field altogether or from making this 
their career - moving from a lower skilled job to a 
higher skilled one," the Committee's May 1970 report 
on the Social Security Amendments of 1970 echoed the 
NCCML study: 

... Both recruitment and utilization of 
laboratory personnel would be greatly en* 
haiiced oy the use of equivalency and 
proficiency examinations. The use of such 
examinations would greatly increase career 
mobility in the laboratory field, thereby 
making the profession more attractive gen- 
erally, facilitating the recruitment and re- 
tention of laboratory workers, and en- 
couraging re-entry into the field by those 
who left it. 

That same year, the Health Training Improvement 
Act of 1970 (P.L. 91-519) authorized HEW in its 
programs for allied health manpower to de'.elop tech- 
niques for "appropriate recognition (including equiv- 
alency and proficiency testing mechanisms) of pre- 
viously acquired training or experience.'* 

The Congressional interest in alternate means of 
qualifying personnel under Medicare regulations 
culminated many months later in the requirement in the 
Social Security Amendments of 1972 (P.L. 92-603) that 
Medicare develop and use proficiency examinations for 
all the many allied health occupations covered by its 
personnel standards. 

There was also considerable Federal interest in 
utilizing the skills of separating medical corpsmen. HEW 



♦Not to be confused with "proficiency testing** - a quality 
control procedure by agencies in the laboratory neld, eval; 
uatine performsince of a laboratory as a whole, not of 
individual workers. 
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and the Department of Defense, following earlier 
experience with Project REMED, had recently formed a 
joint project called **MEDIHC" - Military Experience 
Directed Into Health Careers - through which separating 
corpsmen would be identified and then counseled on 
opportunities for jobs and/or further training in civilian 
health fields. 

Two studies gave some impetus to that project. 
Colonel James J. Young sampled the backgrounds and 
opinions of some 1,500 men representative of the 
21,000 medical corpsmen released to the Army Reserve 
in 1968. He found most of them were highly satisfied 
with their health occupations training and experience in 
the military, but few of them went into civilian health 
occupations when they returned from the service. The 
major reason: lack of status and recognition for military 
training and experience More than 80% said they would 
gladly take an equivalency examination to get credit for 
their military training and experience so as to complete 
their education in less time. Almost as many said they 
would like to take an examination for job placement. 

At the same time, Robert R. Nathan Associates were 
completing a study for the Manpower Administration on 
^Transferability of Military-Trained Medical Personnel 
to the Civilian Sector,** documenting further the fact 
that such corpsmen represent a rich source of civilian 
health personnel, "if they can be provided opportunities 
for training, employment and advancement com* 
mensurate with their education/* 

Military Laboratory Specialists 

In the years just before 1970, the number of military 
laboratory personnel separated each year equalled the 
number going through training courses to replace them. 
Nearly 1,700 servicemen were receiving that laboratory 
training each year, as follows . 



Service 

Army 
Navy 
Air Force 



Short Courses 
(12- 17 weeks) 




Long Courses 
(Approximately 
1 year) 

125 
160 
183 
468 



There was no way to equate military laboratory 
training and experience with the standards of the civilian 
laboratory Held. While the curricula of military lab* 
oratory courses are available, the experiences of military 
laboratory specialists after their initial training vary 
considerably. One may spend many months in a 
comprehensive hospital laboratory performing complex 



With these Examinations, which test the 
ability of a laboratory technician to do the 
job, the way Is open for qualified but now 
ineligible veterans returning from such 
duty overseas to use their skills in the 
civilian economy. Let's hope that Medicare 
can put them to good use. 

-WILBUR D. MILLS, Chairman, 
Committee on Ways and Means, 
U.S. House of Representatives 

(1974) 



specialty determinations under the skilled direction of 
pathologists and clinical scientists; another may be 
assigned aboard a small ship where he is likely to 
perform only the most routine procedures. No system 
exists for detailed documentation of this experience. 

Entry for military laboratory specialists to profes* 
sional certification by the Board of Registry of Medical 
Technologists of the American Society of Clinical 
Pathologists was limited. A corpsman with a bac* 
calaureate degree including the requisite hours of 
chemistry and biology could be eligible for the Medical 
Technologist certifying examination af*er five years of 
experience. Two years of college plus a year*long 
military laboratory course qualifled a candidate for the 
Medical Laboratory Technician examination. For those 
veterans without at least two years of college, the only 
option was certification as a Certified Laboratory 
Assistant - a level with status and pay not usually 
attractive to former corpsmen, and not at all appropriate 
for a 20*year veteran who may have supervised the work 
of a military laboratory. 

The result was that former corpsmen often refused to 
consider an inappropriate entry -level job in a civihan 
laboratory - and all their valuable training and 
experience was lost to the health field. 

Despite Federal interest in using medical c orpsmen*s 
skills, a military laboratory specialist could not tr}>nsfer 
even into equivalent civilian government work, since 
U.S. Civil Service regulations require formal educational 
background. No procedures exist in either Fed »ral or 
state civil service systems for laboratory workers to 
proceed from the technician level to the professional 
technologist level without formal academic study. 



A logical extension of the credit-by- 
examination concept must be conceived, 
developed, and fostered for the allied 
health professions. This is already 
being interpreted as one of the major 
needs if the mobility concept is to be 
achieved .... Based upon effective 
measurement devices of such proficiency 
or equivalency levels, it would not be 
necessary for an individual to begin at 
the very lowest level or rung of a ladder 
in an allied health field, but rather one 
could be admitted into an educational 
program or level of clinical functioning 
based upon his measured capabilities. 



-J. WARREN PERRY, President 
Association of Schools of Allied 
Health Professions (1969) 



Credentialing . . . acts as a barrier to career 
development for substantial numbers of 
persons, many of whom are presumed to be 
competent in their field. The hanging of cre- 
dentialing upon possession of a college degree, 
so common in the health field, is merely a 
reflection of the fact that the determination 
of what constitutes proficiency in a health 
occupation is extremely complex and 
difficult. The Manpower Administration of 
the Department of Labor has given substantial 
impetus to this task through their funding of 
the development of proficiency examinations 
in clinical laboratory fields. 

-THOMAS D. HATCH, Director, HEW 
Division of Allied Health 
Manpower (1972) 



The various interests in equivalency and proficiency 
examinations for the medical laboratory fleld coalesced 
at a meeting of government officials and leading 
pathologists, called on behalf of Roger 0. Egeberg, M.D., 
then HEW Assistant Secretary for Health and Scientiflc 
Affairs, in April 1970, and attended by representatives 
of HEW, Labor, Defense, and the Veterans Adminis* 
tration. Those participating agreed that both types of 
examinations were needed to help solve the manpower 
problems of the medical laboratories. And the path* 
ologists, as the main employers of medical laboratory 
personnel, agreed to assist in the development of 
proficiency examinations and assured the government 
officials they would use the tests in screening discharged 
military laboratory corpsmen as well as civilian on*the* 
job trainees for appropriate positions. 

H£W*s Division of Allied Health Manpower was 
preparing to fund development of a battery of equiv* 
alency examinations for academic credit in the medical 
laboratory fleld - a project initiated and stbuulated by 
NCCML in the course of its study. The tests would be 
developed by Educational Testing Service of Princeton, 
N.J., for the College*Level Examination Program. 

With this background, NCCML proposed that the 
Labor Department's Manpower Admhiistration fund a 
parallel project to develop a series of proficiency 
examinations for job placement, also using the test 
development services of Educational Testbig Service. 
The expectations were that tandem development of the 
two sets of tests would permit coordination, eliminate 
duplication and reduce costs. Their use could also be 
promoted simultaneously. 

In addition, the Labor Department hoped to demon* 
strate the usefulness of proficiency examinations in 
helping to elbninate artificial barriers to jobs for people 
qualified to perform. The applicability of the technique 
throughout the occupational structure was evident. 

Both projects were looked on as possible models for 
other allied health occupations. These other flelds were 
feeling the same pinch of present and projected 
shortages of personnel, were experiencing the same 
desires for career mobility, were looking at the returning 
medical corpsmen whh tlie same interest, and were ripe 
to consider the possibilities of proflciency and equiv* 
alency examinations. There could be no assurance that 
other health fields would make immediate use of the 
projects as guides to solving their own career mobility 
problems, but the experiences would undoubtedly be 
useful in stimulating interest as well as demonstrating an 
approach to the solution. 
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The Contract 



On June 30, 1970, Contract No. 82-22-70-35 was 
signed by the Department of Labor and the National 
Committee for Careers in the Medical Laboratory. 

As an MDTA "Experimental and Demonstration 
Project,'* the contract was awarded by the Manpower 
Administration's Office of Research and Development, 
directed by Howard Rosen, with Seymour Brandwein as 
associate director. William Throckmorton was designated 
project officer. 

The 12-month $199,124 contract called for NCCML 
"to develop proficiency examinations as a means of 
aiding placement and promotion of proficient workers 
who lack formal credentials.*' 

Some of the details were spelled out: 

• An interdisciplinary Advisory Committee would 
guide the project; 

• Test construction would be subcontracted to 
Educational Testing Service; 



• Tests would bc{ developed in four laboratory 
subject areas; 

• Standard scores of working laboratory technicians 
would be obtained; and 

• NCCML would publicize and promote both 
proficiency and equivalency examinations. 

Many other details for implementation were left to be 
decided, in keeping with the experimental nature of the 
project. 

The contract was extended with some accompanying 
increases in the budget, to take advantage of NCCML's 
findings and to use its capabilities in disseminating 
information on this innovation throughout the medical 
laboratory field. In addition NCCML was asked to 
follow up its efforts at hnplementation, as described in 
the section of this report on utilization. 

Of the total $358,250 budget for the entire 43-month 
project, $205,800 was subcontracted to ETS. 



Tlie significance of the health field and the potential 
for work with medical lab workers influencing other 
health occupations, the potential value of wider recog- 
nition of the idea of using proficiency measurement as 
an alternative to academic credentialing, and the 
resourceful past work by this sponsor for DOL and 
HEW, have led to the judgment that we should under- 
write this particular project. 

-HOWARD ROSEN, Manpower Administration, 
Department of Labor (1970) 
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Getting Underway 



Although It was early summer when the Proficiency 
Examinations Project was launched, NCCML was able to 
assemble an outstanding interdisciplinary National Ad- 
visory Committee of eleven persons, and to bring them 
together for a meeting on July 28 with resource people 
and test development experts. Each member was chosen, 
tor what he or she could contribute to the Proficiency 
Examinations project, not as a representative of any 
professional organization. The chairman and several 
members of the Advisory Committee for the Equiv- 
alency Examinations project were included to provide 
correlation with that project. 

The Advisory Committee was to meet three times 
daring the project, providing group guidance as the 
effort began and progres5u^d. Each member also gave 
valuable time and advice individually during the course 
of the project. 

in addition, representatives of key agencies met with 
the Advisory Committee as resource persons, con- 
tributinsi greatly to the project. 

The Advisory Committee members and resource 

persons are listed behw*; 
Advisory Committee: 

Joe M. Blumberg, M.D., Major General, USA 

(Ret.), Co-chairman - Ditectot, Medical Education, 

Hunter Laboratory, Washington, DC 
Mrs. Loula Woodcock, MT(ASCP), Co- 

Chairman Chief Medical Technologist, Scripps 

Memori^ Hospital, La Jolla, CA 
Howard L. Bodily, Ph.D. -Brigham Young University, 

Provo, UT; formerly Chief, Laboratory Services, 

California State Health Department, Berkeley, CA 
James L. Hansen, Colonel, MC, USA-Director, 

Armed Forces Institute of Pathology, Washington, 

DC 

Clarence R. Jones, MLT(ASCP)- Executive Director, 
Cure Health Plan, Inc., Chicago. IL; formerly 
Administrative & Technical Assistant to the 
Pathologist, Faith Hospitals, St. Louis, MO 

Harold 1. Lewack-Manpower Analyst, Division of 



'^Titles are those held at that time. 



Program Development and Legislative Services, 
Manpower Administration, Department of Labor, 
Washington, DC (Deceased, 1971) 

Robert S. Melville, Ph.D.-Chief, Chemical Sciences 
Section, Research Grants Branch, National In- 
stitute of General Medical Sciences, Bethesda, MD 

A. Wendell Musser, M.D.-Assistant Chief Medical 
Director for Planning & Evaluation, Veterans 
Administration, Washington, DC (Chairman, 
Equivalency Examinations Advisory Committee) 

John Peterson- Administrator, Valley Hospital, 
Ridge wood, N J 

Martha Phillips, M.S., MT(ASCP)--Chief, Allied 
Health Training, Veterans Administration, Wash- 
ington , DC 

Harvey I Scudder, Ph.D.-Head, Division of Bio- 
logical & Health Sciences, California State College, 
Hayward, CA (Member, Equivalency Examinations 
Advisory Committee) 

Resource: 

Lt. Col. Robert C. Barnum, USA-MEDIHC Coordl* 
nator. Transitional Manpower Program, Depart- 
ment of Defense, Washington, DC (to July 1971) 

William R. Bishop, Ph.D.--Asslstant Director, De- 
partment of Allied Medical Professions and 
Services, American Medical Association, Chicago, 
IL 

Marlon M. Brooke, Sc.D. -Chief, Laboratory Con- 
sultation and Development Section, Center for 
Disease Control, Atlanta, GA 

Donald E. Brown, M.D.-Dlrector of Laboratories, 
Hackensack Hospital, Hackensack, NJ (Chairman, 
ASCP Board of Registry; from October 1971) 

E. Martin Egelston -Assistant Director, Bureau of 
Manpower and Education, American Hospital 
Association, Chicago, IL 

Donald F. Foy-Director, Department of Health 
Manpower, American Medical Association, 
Chicago, IL 

Robert M. Gertz-Dlrector, Medical Technology 
Services, American Society of Clinical Path* 
ologists, Chicago, I L 

Karen Greene-Manpower Analyst, Office of Re* 
search and Development, Manpower Admtnis* 
tratlon. Department of Labor, Washington, DC 
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David Hoover- Associate Director for Program I'^an* 

ning and Evaluation, Division of Allied Health 

Manpower, PHS, Bethesda, MP 
Paul C. LeGolvan, M.D.- Assistant Director, Path* 

ology and Allied Sciences Service, Veterans 

Administration, Washington, DC 
ColUi R. Macpherson, M.D.-Director, Division of 

Laboratory Medicine, Ohio State University Hos* 

pital, Columbus, OH (Chairman, Board of Schools) 
Barbara C. Nagel-Public Health Advisor, Division of 

Medical Care Standards, Community Health 

Service, PHS, Rockvllle, MD 
Lt. Col. Walter J. Seaman, USA-MEDIHC Coordi- 

nator. Transitional Manpower Program Depart* 

ment of Defense, Washington, DC (from July 

1971) 

Capt. Ouida Upchurch-Director, Education and 
Training Sciences, Naval Medical Research In* 
stitute,Bethesda,MD 

George P. Vennart, M.D. -Professor of Clinical Path- 
ology, Medical College of Virginia, Richmond, VA 
(Chairman, ASCP Board of Registry; to October 
1971) 



Baseline Decisions 

The Advisory Committee at its first meeting defined 
the scope of the project. Major decisions reached were 
these: 

Name of the Project: Committee members recognized 
that ^'proficiency testing'' in the laboratory field 
customarily refers to the sending of blind samples to 
laboratories for testing as a quality control check on the 
proficiency and accuracy of the laboratory as a whole, 
not of individual laboratory workers. Since the present 
project had no connection with this testing practice, 
there was bound to be confusion. Nonetheless, the word 
''proficiency'' was already in use in the allied health field 
to refer to the type of tests to be developed by this 
project. No other equally descriptive term was suggested. 
Thus the name "Proficiency Examinations for Clinical 
Laboratory Personnel" was agreed to, recognizing there 
would be some attendant confusion to counteract. One 
method of counteracting that confusion has been to 
refer whenever possible during the course of the project 
to ''proficiency examinations," rather than "proficiency 
tests." Another word received some scrutiny. Although 
"Medical Laboratory Personnel" had been NCCML's 
usual description of the population to be served, 
"Clinical Laboratory Personnel" was substituted to 
demonstrate the interdisciplinary nature of the project. 

Proficiency and Equivalency: A source of more 
misunderstanding from outsiders throughout the project 
was ♦o be the distinction between "Proficiency" and 
"Equivalency" examinations* With the expectation this 



For those interested in career development 
for medical and health workers, ''equiva- 
lency testing" and ''proficiency testing" 
are magical words. They represent 
strategies for career development that 
are often discussed and much hoped for, 
but are somehow never there, like a 
mirage. Now, however, the mirage is 
turning into a reality, at least in one small 
corner of the vast field of health-the 
clinical laboratory. 

--Comprehensive Health Services 
Career Development Technical 
Assistance Bulletin, National 
Institute for New Careers (1970) 



would be the case, definitions were agreed on and 
included in the first Progress Report: 

Equivalency Examinations ^ are used to 
equate non*formal learning with learning 
achieved in academic courses or educational 
programs. Such tests are designed to enable 
colleges and universities to grant academic 
credit for off-campus learning. 

I^oficiency Examinations are used to meas* 
ure an individual's competency to perform 
certain jobs at certain levels - a competency 
made up of knowledge and skills and related 
to the requirements of the specific job. Such 
tests are designed to enable employers to 
place workers at appropriate job levels^ 
irrespective of their formal certifiable 
credentials. 

Laboratory Fields: The Advisory Committee con- 
firmed the proposed divisions of the laboratory field for 
the project, and directed that tests be developed in the 
following four areas, encompassing the greatest number 
of laboratory tests and procedures: 

Clinical Chemistry 
Microbiology 
Hematology 
Blood Banking 

Job Level of Examinations: Tests were to be designed 



7 



ERLC 



(We) encourage establishment of 
educational equivalency measures and job 
performance tests as alternative routes to 
licensure of health care pe> sonnel. The 
requirement that an employee with 
experience, interest and capability for 
job* advancement be classified the same as 
a new student or an inexperienced 
employee is not reasonable. Therefore, 
state statutory revisions that grant 
advanced educational or job placement 
to individuals possessing previous 
educational work experience 
equivalent to that required in an 
accredited education program should be 
actively supported. Support also 
should be given to the development 
of equivalency measures and job 
performance tests by test-making 

agencies. 

-Board of Trustees, American 
Hospital Association (1970) 



to evaluate the job-related skills and knowledge of a 
laboratory technician - that is, a wQrker standing 
generally above a laboratory assistant and below the 
baccalaureate degree position of Medical Technologist. 
The tests were to have sufficient range to locate workers 
on a scale above and below the average technician. Thus 
they were to contain some difficult questions as well as 
some ea^ ones. 

Type of Examination: The Advisory Committee 
considered the possibilities of requiring a demonstration 
of performance, since ability to perform is the key to 
proficiency In the clinical laboratory. Yet the historical 
difficulties with practical tests and recent progress made 
with paper-and-pencil tests led to the conclusion that the 
latter were preferable for this project. Observation of 
actual performance in a laboratory would not only 
increase the cost and problems of administering the 
examinations, but would reduce the objectivity of the 
results. Those for whom the examinations were to be 
designed, it was pointed out, have been working in 
laboratories; this fact alone would presume some 
practical competence. The Advisory Committee en* 
dorsed the premise that the examinations should be 
paper-and-pencil tests, simulating real conditions to the 
extent possible. 

Examining Committees: Two major f unctions of the 
Advisory Committee were to develop guidelines for the 
naming of the four Examining Committees and to 
nominate their members. Each Committee was to consist 
of three to five laboratory experts, including in each 
case: (1) an M.D. skilled in the discipline under 
consideration, (2) a clinical scientist from the specialty^ 

(3) someone from the military laboratory system, and 

(4) someone from an intermediate laboratory level, such 
as a Medical Technologist or Master Sergeant from the 
discipline involved. Finally, and most important, every 
Examining Committee member should be thoroughly 
familiar with the specialty under consideration. Potential 
Committee members were nominated. 

Timetable: A rougli time schedule for the project 
showed that if the Examining Committees began work 
immediately and test speciflcations were ready by 
September, test items could be approved by December, 
pretesting could occur in April, and the flnal tests would 
be ready for norming by the end of June. Another three 
months would be required for the norming adminis- 
tration and analysis of the results, with a report on the 
d.ita due at the end of September. Further discussion 
during the year would bring out the possibilities for 
promoting the examitiatlons and utilizing their results. It 
was agreed. 



Test Construction 



In order to complete the project within the time limits 
imposed, the tlrst two-day v/ork sessions of the 
Examining Committees had to be scheduled for the last 
two weeks of August in Princeton, New Jersey. This was 
just two weeks away. 

NCCML staff issued invitations by phone, and then in 
writing, to the nominees the Advisory Committee had 
named as potential Committee chairmen and members. 

An early demonstration of the interest in the 
project's possibilities was the fact that 17 out of 18 
laboratory experts invited to participate agreed to do so. 
Many changed other plans in order to come to 
Princeton; one Committee chairman interrupted his 
vacation for the initial meeting. The Exambiing Com* 
mittee members were as follows: 



Oinical Chemistry 

Martin Rubin, Ph.D., Georgetown University Hos* 

pital, Washington, DC, Chairman 
Mst. Sgt. James R. Brown, Medical Field Service 

School, Fort Sam Houston, TX 
Howard Rawnsley, M.D., Hospital of the University 

of Pennsylvania Medical School, Philadelphia, PA 
Loula Woodcock, MT(ASCP), Scripps Memorial 

Hospital, La Jolla, CA 

Microbiology 

Gerald Needham, Ph.D., Mayo Medical School, 

Rochester, MN, Chf*irman 
Lt. Walter Cox, M.Sc. (USNR), National Naval 

Medical Center, Bethesda, MD 
Sgt. John James, USAF Medical Center, Wright- 

Patterson AF Base, Dayton, OH 
Jesse Marymount, M.D., Wesley Medical Center, 

Wichita, KS 

Cornelia Van Bentham, M.A., MT(ASCP), Hacken- 
sack Hospital, Hackensack, NJ 

Hematology 

Robert Langdell, M.D., University of North Carolina 
Medical School, Chapel Hill, NC, CMrman 

M^or Joseph H. Keffer, M.D., Anderson Pathology 
Associates, Anderson, SC 



Doris Mahon, Walter Reed Army Medical Center, 

Washington, DC 
Gwendolyn N. Taylor, MT(ASCP), Medical University 

of South Carolina, Charleston, SC 
Blood Banking 

Lt. Coh Frank Camp, U.S. Army Medical Research 

Laboratory, Ft. Knox, KY, Chairman 
Ralph Lingeman, M.D., Veterans Administration 

Hospital, Washington, DC 
Grace Neitzer, MT(ASCP), Michigan Community 

Blood Center, Detroit, MI 
Lt. Col. Harold Neuman, Malcobn Grow USAF 

Medical Center, Andrews AF Base, Washington. 

DC 



Educational Testing Service • — 

Although it was to be some months before the 
technicalities of the subcontract were spelled out, 
Educational Testing Service began immediately to 
expend its staff energies and its own funds on the 
project. Without this complete cooperation, the tight 
time schedule would have been impossible to meet. 

Educational Testing Service work on the Proficiency 
Examinations has been coordinated by Jane L. Houis, 
program director in the Government and Career Pro- 
grams Division. She has been assisted by Betty Kleiner 
and Linda Kellner, administrative assistants in the 
Division. 

Test development in the Science Department of BTS 
has been the responsibility of Frank J. Fornoff, Ph.D., 
chairman and senior examiner of the Department; 
William Kastrlnos, senior examiner; Susan Countess, 
assistant examiner; and Gertrude G. Sanders, assistant 
examiner. 

Also present at some of the Examining Committee 
meetings were Robert J. Solomon, BTS executive vice 
president; Samuel Messick, vice president; Peter Loret, 
senior program director of the tiovernmeut and Career 
Programs Division; and H. Eugene Kessler, assistant 
director of the Test Development Division. 
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Additional assistance In technical aspects of test 
development came from Jane Ellen Groth, head, pretest 
and item flies; Betty Haven, senior statistical associate; 
Nancy Heath, senior programmer analyst; and Cheryl 
Reed, statistical associate. 

Test Specifications 

A major assumptioo had been made by the Advisory 
Committee that properly-constituted Examining Com- 
mittees could come together in Princeton for two days 
and agree on the knowledge and skills, weiglued for 
importance, to be expected of technicians performing 
successfully in each of the four areas of the clinical 



laboratory. There was no time and there were no funds 
for observation or recording and analysis of work 
processes. 

Both the Advisory Committee and ETS were pleased 
with the results. 

Each of the four Examining Committees developed a 
list of test specip.cations, including time, number of 
questions, difficulty, level of proficiency to be meas- 
ured, test content (with percentages indicating weight to 
be given to the subject matter breakdowns), abilities to 
be measured, and types of items. These specifications 
were circulated to the Advisory Committee and then 
much more widely in a Progress Report to more than 



EXHIBIT A: 

Test Specifications 

CLINICAL CHEMISTRY 

C0NT6NT 

I. Equipment 15%) 

A. Centrifugation; filtration 

B. Pipettes* diluters 

C. Balances 

D. Glassware, volumetric 

II. Instruments: principles of, use of, and understanding of 

(20%) 

A. Spectrophotometry and colorimetry (6%) 

B. Flame photometry and atomic absorption 12%) 

C. Automated equipment: auto-analyzers 15%) 
O. Pluorimetry 

E. Blood gases: ion-specific electrodes 

F. Electrophoresis 

0. Calculating devices: slide rule, machine, computers 
H. Isotopic instruments: well counters 

1. Osmometers 

J. Chromatography 

III. Chemical Principles and Applications <24%) 

A. Calculation and measurements units (6%) 

B. Identity and sources of biological specimens, speci- 

men handling, preservation, collection (6%) 

C. pH, solutions, buffers, water, normality, molarity, 

osmolarity (60%) 

IV. Methodology (51%) 

A. Enzymology (7%) 

1 . For clinical applications (to be measured) 

2. For use as reagents (for measuring) 

B. Proteins including cerebrospinal and other body 

fluids (5%) 

1 . Measurement 

2. Fractionation 

C. Other nitrogenous materials (5%) 

1. Urea 

2. Creatinine including clearance tests 

3. Amino acids 



4. Ammonia 

5. Uric acid 

6. Creatine 

D. Lipids (3%) 

1. Cholesterol and other sterols 

2. Qlycerides 

3. Fatty acids 

4. Lipoproteins 

5. Carotene 

E. Carbohydrates including tolerance tests (7%) 

1. Qlucose 

2. Xylose 

3. Galactose 

F. Electrolytes, etc. (7%) 

1. Na, K, CI, Ca, Mg, P, Fe 

2. Trace metals 

3. CO2.PH 

4. Acid/base balance 

5. Nomogram 

0 Endocrine procedures (3%) 

1. Thyroid function 

2. Adrenal (catechol amines, VMA, epinephrine, 

5-HIAA) 

H. Liver function (5%) 

1. Bilirubin 

2. BSP 

I. Toxicology (3%) 

1. Salicylates 

2. Bromides 

3. Barbituates 

4. Ethanol 

5. Reinsch test for heavy metals 

6. Drugs (Li) 

J. Urine chemistry (5%) 

1. Pigments 

2. Reducing materials 

3. Screening techniques: reagent papers 

K. Other (gastric analysis, vitamins) (1%) 
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200 persons interested in the project. Reactions were 
uniformly favorable. 

The general specifications were the same for all of the 
four tests. There were to be two forms of each test. Each 
was to be made up of 75 paper«and«pencil questions 
which would simulate practical conditions at the 
laboratory bench. The time for each was to be 60 
minutes. The tests were all designed to measure the 
job«related skills and knowledge necessary for a 
laboratory technician, with f^nough range to locate 
workers somewhat above and below that level. Each of 
the Examining Committees therefore aimed to develop a 
test of considerable difficulty - so that the average 



candidate would score only about 50-60% correct 
anbwers. 

Test content, the abilities to be measured, and the 
types of items varied for each of the tests. These are 
shown in Exhibit A. 

Item Writing 

Some 400 draft items (test questions) were needed in 
each field, to be winnowed eventually to ISO per Held, 
since each of tie two test forms was to have 75 items. 

A three<way responsibility for writing the items was 
set up. Examining Committee members did a m^jor part 
of the initial work, drafting some 25 items apiece. 



ABILITIES 

(As defined by Bloom's Taxonomy of Educational Objec- 
tives) 

Knowledge: 2S% 

Application: 65% 

Higher abilities: 10%^ 

(including analysis, evaluation, synthesis) 

ITEM TYPES 

PrincipaUy, five*choice completion questions 
Secondarily, classification sets and situational sets of ques* 
tions 



MiCROBiOLOQY 

CONTENT 

I. Specimen and Culture Handling (10%) 

A. Collection of specimens (4%) 

B. Transportation (intra*and*extra) (3%) 

C. Record*l(eeping (0.6%) 

D. Storage (2%) 

E. Disposal and disinfection (0.6%) 

II. Isolation and Identification (60%) 
A. Bacteriology (30%) 

1. Isolation from: (13%) 

a. urine 

b. blood \ (8%) 

c. stool 

d. nose and throat 

e. other (tissue, spinal fluid, sputum, 

wound) (6%) 

2. Identification: (17%) 

a. Enterobacteriaceae (9%) 

b. Qram*positive cocci (5%) 

c. Others (anaerobes, Qran^negative cocci. 

Hemophilus) (3%) 
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III. 



Parasitology (10%) 
1. Examination of: 

a. blood (2%) 

b. stool (7%) 

c. other (1%) 
C* Mycology (3%) 

1. Isolation 

a. Superficial 

b. Systemic 

2. Identification 

0. Mycrobacteriology (7%) 

1. Isolated from: 

a. contaminated areas 

b. sterile areas 

c. tissue 

2. Identification 

a. cultural 

b. biochemical 
Serology (16%) 

A. Tests for disease identification (8%) 



1. Syphillis 

2. Mono 

3. Strep 

4. Pebriles 

5. Cold Agglutinins 

B. Tests for organism identification (5%) 

1. Enterobacteriaceae 

a. Salmonella 

b. Shigella 

c. E. coli 

2. Positive Cocci 

a. Streptococcus 
b* Pneumococcus 

C. Pregnancy (1%) 

D. Miscellaneous (1%) 

1. Rheumatoid Arthritis 

2. Thyroid 

IV. Antibiotic susceptibility by the standardized disc text 
(Kirby-Bauer) (6%) 

A. Media (0.5%) 

B. Innoculation (O.B%) 
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Outside item writers recommended by the Committee 
members came up with many more. For all items, ETS 
Science Department staff provided necessary editorial 
services. 

Examining Committee members were given an 
orientation to question-writing at the August meetings. 
They wrote and reviewed various types of questions so 
as to become familiar with the procedures themselves 
and to prepar samples which would later guide the 
other item writers. 

ETS stafT members wrote to laboratory experts 
whose names had been suggested as potential item 
writers, and those who accepted the job (see Exhibit B) 



were sent instructional materials that had been reviewed 
by the Committee members. The materials explained the 
purposes of the project, outlined the test specifications, 
and showed samples of the types of questions to be 
drafted. Each item writer received a specific request for 
certain types of questions covering certain specific 
content areas. 

Examining Committee members and outside item 
writers received honoraria for their work hi developing 
the tests. One Committee member estimated she had 
spent the equivalent of five eight-hour working days at 
home on the task - not including the trips to Princeton 
- and counted it a most stimulating experience. 



C. Discs (2%) 

1 . Concentration 

2. Application 

3. Storage 

D. Interpretation (2%) 

V. Media <10%) 

A. Types {?%) 

1. Basic 

2. Differential (selective) 

3. Enrichment 
8. Preparation (3%) 

1. Age 

2. pH 

3. Sterilization 

4. Storage 

VI. Equipnoent 

A. Microscope (Light, dark-field, fluorescent) (3%) 
6. Centrifuge 

C. Sterilizing equipment 

D. Anaerobic equipment (2%) 

E. Incubation equipment 

F. Rotators 

VII. Quality Control (5%) 
A. Staining (1.5%) 
8. Reagents (1.5%) 
C. Media (2%) 



ABILITIBS 

(As defined by 6loonr»'s Taxonomy of Educationa/ Objac- 

tivas) 
Knowledge: 40% 
Application: 60% 
Comprehension: 5% 
Analysis: 5% 

ITEM TYPES 

Five*choice completion: 60% 
Five^choice classification sets: 20% 
Diagram sets: 10% 
Laboratory sets: 10% 



HEMATOLOGY 

CONTENT 

1. White Count (7%) 

2. Red Count i33%) 

3. Hemoglobin (7%) 

4. Hematocrit (7%) 

5. Normal differential count (10.6%) 

6. Reticulocyte count (3.5%) 

7. Sedimentation rate (5.5%) 

8. Platelet count (5.5%) 

9. Prothrombin time (7%) 

10. Partial thromboplastin time (7%) 

11. Coagulation time (5.5%) 

12. Bleeding time (3.5%) 

13. Clot retraction (2%) 

14. Fibrinogen and lysis (2%) 

15. Sickle preparation (3.5%) 

16. Electrophoresis (Hemoglobin) (3.6%) 

17. LE Preparation (2%) 

18. Osmotic fragility (2%) 
19 Immunoglobulins (2%) 

20. General techniques (7%) 

21. Urine sediment examination (3.5%) 

A second aspect of the content for this examination is 
represented by the following categories: 

(A) Manual 

(B) Mechanized 
(C> Quality 

(D) Limits of the method 

(E) Departure from the normal 



ABILITIBS 

(As defined by Bloom's Taxonomy of Educational Obfac- 
tfvas) 

Questions will primarily test knowledge and application, with 
a small number testing comprehension. 
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When the newly written questions were received at 
ETS, they were put into uniiorm editorial style and then 
mailed to the appropriate/ Examining Committee 
members for review. Each exam^er reviewed each of the 
questions in his fleld, selected an answer t3 it, and rated 
it as to the appropriateness of the content and the 
adequacy of the wording. Answers, ratings and com- 
ments from all Committee members were assembled in 
form for easy review by the Committees. 

The Committees met again late in the year to come 
up with completed questions. Guided by the assembled 
comments and by their face-to-face discussions, they 
determined which of the submitted questions were 



suitable for further consideration. Some were discarded 
because they were not at the proper level, some were 
revised to make sure they had only one correct answer, 
and some were accepted as submitted. 

The questions received a further review by the ETS 
Science Department staff to locate places where tech* 
nically acceptable simplifications of wording were 
possible and by the ETS editorial staff for grammatical 
flaws and uniformity of style. Then some 250 questions 
in each field were readied for pretesting - to determine 
the difficulty of the questions and to locate ambiguities 
in wording. Copies of the assembled pretests were sent 
to Exambiing Committee members for review. 



ITEM TYPES 

Principally, five«choice completion questions 
Secondarily, classification sets and diagram sets 

COLOR 

Alone among the Examining Committees, the Hematology 
Committee recommended the use of color as highly impor- 
tant. A sheet of color plates was prepared and included in the 
examination booklet. 



BLOOD BANKI NG 

CONTENT 

I. Immunology and Genetics (10%t 

A. Genetics (2%) 

B. Antigen - antibody reactions <8%) 

1. Complement 

2. Agglutination 

3. Hemolysis 

4. Antiglobulin test 

6. Optimal conditions of reaction 

II. Blood Group Systems (26%) 
A. A.B,0<12%) 

1. Forward typing 

2. Reverse typing 

3. Subtyping 

4. Problems 
6. Rh (8%) 

1. Rho<D) 
?. Phenotyping 

3. Probhms; such as butologous control 

C. Other (5%> 

1 . Other blood group systems 

2. Private antigens 

3. Public antigens 

III. Compatibility <2B%> 



A. Routine procedures (7%) 

8. Massive transfusions (2%) 

C. Multiple transfusions (2%) 

0. Exchange transfusions for hemolytic disease (2%) 

E. Rh Immune globulin (2%) 

F. Transfusion of blood components (2%) 
Q. Patient identification (4%) 

H. Selection of blood for compatibility Universal 
donor (4% t 

IV. Special Techniques (10%) 

A. Antibody detection 

B. Antibody identification 

C. Elution techniques 

D. Transfusion reaction woric«up 

E. Hemolytic disease work-up 

F . Auto-immune disease 

V. Standards* General Procedures (30%) 

A. Donor requirements 

B. Collection of blood 

C. Identification of donor blood (14%) 

D. Care of donor 

E. Storage and transportation (4%) 

F. Preparation of components (4%) 

G. Transfusion service records (4%) 

H. Blood group reagents and equipment (4%) 



ABILITIES 

(As defined by Bloom's Taxonomy of Educational Objec* 

tlves) 
Knowledge: 40% 
Comprehension: 10% 
Application: 40% 
Analysis: 10% 

ITEM TYPES 

Discrete five«choice completion: 70% 
Classification sets: 10% 
Multiple completion: 10% 
Situational sets: 10% 
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BXHiBtTB: 

Item Writers 



CLIKiCAL CHEMISTRY 

Dean Arvan, M.D., Philadelphia, PA 

Myrton F. Beeler, M.D., New Orleans, LA 

Rex 8. Conn, M.D., Baltimore, MD 

James R. Heltsley, MS, MT(ASCP), Auburn, AL 

Roy B. Johnson, Jr., La Jolla, CA 

Kai Kristenfetl, M.D., La Jolla, CA 

Col. Howard C. Leifhelt, Fort Sam Houston, TX 

Glenn W. Madere, Jr. San Antonio, TX 

Robert Modica, Grand Rapids, Ml 

Solomon Notrica, Long,6each, CA 

MSG Henry M. Radcliffe, Jr., MT(ASCP), Fort Sam 
Houston, TX 

Major Charles Ritchey, Fort Sam Houston, FX 

Jenny Seaton, MT(ASCP), Lexington, KY 

David Seligson, M.O., New Haven, CT 

Emilio P. Unanue, M.O., San Diego, CA 

MICROBIOLOGY 

W. E. Bernard, HMC, Bethesda, MD 
Donna J. Blazevic, Minneapolis, MN 
rElleen Broberg, Wichita, KS 
Dennis L. Carr, M.A., Wichita, KS 
Frances Casey, Brooklyn, NY 

Harry P. Dalton, Ph.D., Richmond, VA 

Charles E. H. Fenton, Burlington, VT 

Malor Robert Marraro, Columbus, OH 

William J. Martin, Ph.D., Rochester, MN 

Richard Rosner, Paterson, NJ 

Lt. Deane Shubert, MSC, USN, Portsmouth, VA 

Capt. William W. Sultan, Jr., USAF. Wright*Patterson AFB, 
OH 

M. C. Wethington, West Caldwell, NJ 



S/M Sgt. Fred R. Williams, Wright-Patterson AFB, OH 
HEMATOLOGY 

Barbara Aushter, Silver Spring, MD 

James J. Biemer, M.D., Tampa, FL 

Lawrence Clark, Landover, MD 

Jane Dorsey, Charleston, SC 

Robert J. Hartsock, M.D., Pittsburgh, PA 

Joyce loannidis, Charleston, SC 

Robert E. Jones, M.D., Anderson, SC 

James H. Kelly, M.D., Albany, NY 

Mary Margaret Kelley, Kansas City, MO 

Capt. Clyde Marsteller, Silver Spring, MD 

Mrs. Robert Newsome, Silver Spring, MD 

Anne Stiene, Lexington, KY 

TSQ Raymond L. Summers, Montgomery, AL 

Ann Thompson, Charleston, SC 

BLOOD BANKING 

LTC Truman E. Allen, Jr., Fort Knox, KY 
Kathryn Beattie, BB, MTlASCP), Detroit, Ml 
Irene Block, MT(ASCP), Detroit, Ml 
Ma)pr Jerry R. Brewer, Oxon Hill, MD 
Jane C. Corner, MTiASCP), Rochester, MY 
Mary Jessie Craycroft, MT(ASCP), Fort Knox, KY 
Narcissa Hooker, BB, MT(ASCP), Indianapolis, IN 
Lt. Donald R. Levan, MSC, USN, Washington, DC 
Margaret E. McPeak, MT(ASCP), Fort Knox, KY 
Corinne Monroe, BB, MT(ASCP), Long Beach, CA 
L. M. Pieasant, DAC, El Paso, TX 
Lt. Col. William B. Price, Andrews AFB, MD 
Major James E. Spiker, Jr., Fort Sam Houston, TX 
Joseph M. Tuggle, Rockville, MO 
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Pretesting and Norming 



Both pretesting and norming were required, once the 
test items had been prepared. 

Pretesting is trying out each suggested test item to 
iearn about its ambiguities, its difficulty, and whether it 
discriminates well between those who generally Icnow 
the subject of the test and those who don't. Pretested 
items can be discarded, revised, or used "as-is*' in the 
final version of the test, depending on what has been 
learned about them. 

Norming is administerbig the flnal examination to a 
sample population to provide scales with which an 
individual candidate's score can be compared. 

NCCML assembled a Subcommittee on Pretesting anc^ 
Norming for a one*day meeting in November 1970 to 
consider with ETS staff the requirements for pretesting 
and norming and to recommend a means of obtaining 
the cooperation of sufficient numbers of laboratory 
workers to talce the tests on such a trial basis. 
Subcommittee members were: 

Joe M. Blumberg, M.D., Major General, USA 
(Ret.), Co-Chairman of the Proficiency Examina* 
tions project 

E. Martin Egelstor, American Hospital Association 
John Foft, M.D., Chairman, Department of Clinical 

Pathology, University of Alabama Hospitals 
Coh Harvey P. Graham, M.D., Office of the Surgeon 

General, Department of the Army 
Linda J. McKay, Management Analyst, Education 

Service, Veterans Administration (representing Ms. 

Phillips and Dr. Musser) 

The Advisory Committee had stated that the norming 
population must be - and the pretesting population 
should be - made up of those who have recently 
reached the level it is hoped those taking the completed 
examinations can reach. While the contract for the 
project required that the examinations be normed on 
those who have passed the ASCP Certified Laboratory 
Assistant - CLA(ASCP) - examination, the Advisory 
Committee regarded this specification as a mhiimum. 



The Subcommittee took this and other Advisory 
Committee recommendations, considering them in the 
light of practical problems Involved, and agreed on the 
following guidelines for those who would be asked to 
participate in the pretesting and norming: 

• 900 participants should be sought for pretesting 
and 1,200 for norming. 

• Participants should understand the project and its 
hoped*for impact on laboratory careers and should 
be motivated to do a good job. There were no 
funds to pay honoraria. 

• Participants should have been working successfully 
in a clinical laboratory for at least a year. There 
would be no review of hidividual qualifications, 
rather a reliance on the judgment of the supervisor 
asked to volunteer the employee's time. 

• A random mix of specialists and generalists could 
be expected to yield hoped*for pretesting and 
norming results. All participating generalists and 
specialists would be examined in all four subject 
matter areas. 

• Participants should reflect a geographical spread 
and various types of facilities, 6.g. (1) military 
hospital laboratories, (2) civilian hospital lab- 
oratories, including VA hospitals, PHS hospitals, 
other public and private hospitals, and (3) 
independent laboratories. 

• For norming purposes, additional qualifications 
would be sought. There should be a group at the 
baccalaureate level - MT(ASCP) certified or with 
a baccalaureate degree. A second group would be 
at the technician/assistant level, including 
CLA(ASCP) or MLT(ASCP) certified, or workers 
meeting Medicare technician standards (including 
those who have been technician trainees in 
acceptable laboratories for two years, or those 
who have completed the one*year laboratory 
course in one of the Armed Services). 
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EXHtBfTC: 

Pretesting/Norming Participants 



N0N*FEO6RAL HOSPITALS 

OeKalb General Hospital, Decatur, OA (Prankie Murphy) 
OePaul Hospital, Norfolk, VA (Robert J. Palconer, M.D.) 
Georgia Baptist Hospital, Atlanta, QA (Robert E. OeLashmutt, 

M.O. and Charles E. Allen, MT(ASCPM 
Medical Center Laboratory, Yakima, WA (Sandra ProebsteO 
Memorial Hospital Medical Center, Long Beach, OA <E. R. 

Jennings, M.O.) 
Mercy Hospital, Baltimore, MO (R. T. Lancaster, M.DJ 
Saint Agnes Hospital, Pond du Lac, Wl (R. E. Cariovsky. 

M.D. and Hattie Skilbred, MT(ASCP)) 
Saint Joseph's Hospital* Tacoma, WA (D. E. Wilhyde* M.D.) 
Saint Vincent Infirmary, Little Rock, AR (Allen R. Rozzell. 

M.D.) 

West Jersey Hospital, Camden, NJ (Ms. Warwick) 

VETERANS ADMINISTRATION HOSPITALS 

V. A. Hospital, Los Angeles, OA (Ben Pishkin, M.D.) 
V. A. Hospital, Hines, IL (John dinger, M.D.) 
V. A. Hospital, Minneapolis, MN (Miguel Azar, M.D.) 
V. A. Hospital, East Orange* NJ (P. Tabenkin) 
V. A. Hospital, New York City, NY (Norman S. Cooper, 
M.D.) 

V. A. Hospital, Wood, Wl (Karl Pintar, M.D.) 



PUBLIC HEALTH SERVICE HOSPITALS 

U.S. Public Health Service Hospital, New Orleans, LA 

(William B.Cherry, M.O.) 
U.S. Public Health Service Hospital, Staten Island, NY 

(James Hensley) 

HOSPITAL ASSOCIATIONS 

Connectteut Hospital Association, New Haven* CT (Robert 
D. Bergeron) 

Health Careers Council of Illinois, Chicago, IL (Donald C. 
Frey) 

Kansas State Hospital Association, Topeka, KS (Larry 
Shaffer) 

Twin City Hospital Association, Minneapolis, MN (Mildred 
K. Brown) 

Hospital Research & Educational Trust of New Jersey, 

Princeton, NJ (Thomas P. Gallagher) 
South Carolina State Hospital Association, West Columbia, 

SC (Herbert Weisberg) 

INDEPENDENT LABORATORIES 

Associates in Laboratory Medicine, Tuscon, A2 (Clyde 
Kersten) 



Many of these guidelines were followed closely as the 
project continued. Others proved to be hnpractical or 
unadvisable as circumstances developed. 

Pretesting 

Subcommittee members and others sought assistance 
from laboratories willing to participate in the pretesting. 
Laboratory directors and supervisors were asked to 
select workers who met the criteria listed above. Many 
agreed to help. 

Military- laboratory cooperation was easily obtained 
as a result of the approval and assistance of the Armed 
Forces Institute of Pathology and the Army Surgeon 
Generates Office. The Veterans Administration head* 
quarters pathology service secured the cooperation of 
laboratories in several VA hospitals. Public Health 
Service hospitals were also involved. 

Cooperation from other hospitals came through the 
efforts of state and metropolitan hospital associations 
suggested by the American Hospital Association. Local 
pathology and medical technology societies and hospital 
administrators helped to assemble workers from small 



and large, urban and rural hospitals. Directors of 
independent laboratories volunteered to cooperate as a 
result of an NCCML mailing to Medicare-approved 
laboratories to solicit participation in the pretesting and 
norming process. 

Exhibit C lists the hospitals, laboratories and organi* 
zations which participated in the pretesting process in 
March 1971 and the initial norming a few months later. 

Test experts at BTS were delighted with the pretest 
results, pronouncing them the best they had ever had in 
a biological science Held. 

Answer sheets from the pretesting were the basis for 
determining the difficulty of each question, the number 
of pretest candidates selecting each of the options for 
each question, and mean test scores of test*takers who 
chose each option. The relationship of performance on 
each question with performance on the test containing 
the question was also obtained. 

On the basis of the test descriptions prepared by the 
committees of examiners and of the results of the 
pretesting, BTS assembled two forms of each of the four 
tests. Each form was unique: no question appeared on 
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Bloomington Cornbelt Biochemical Laboratory, Inc., 

Bioomington, IL (Joyce Yeast) 
Colonial Laboratory, Orlando, FL (Richard Carr) 
Ferris Medical Laboratory, Lawton, OK (Gary Lavallee) 
Kauffman Laboratory, Memphis, TN (Frances C. Kauffman) 
Lattimore*Fink Laboratory, Topeka, KA (Mrs. Paula M. 

Quinley, MT/ASCP) 
Medical Services Laboratory, Dubuque, 10 (Robert Dimel) 
Pathology Laboratory, Los Gatos, CA (Corrine McAlpin) 
Penn Medical Laboratory, Pittsburgh, PA (Joseph 

Scandinarol 



AIR FORCE HOSPITALS 

Andrews Air Force Base, D.C. (M/Sgt. Anthony W. Webster) 
Carswell Air Force Base, TX (Maj. Robert G. Houston) 
Chanutte Air Force Base, IL (Maj. Euril W. Perry) 
Davls-Monthan Air Force Base, AZ (Maj. John F. Schultz) 
Elgin Air Force Base, FL (M/Sgt. Harrington) 
Fairchild Air Force Base, WA (Maj. Frank J. Holub) 
Keesler Air Force Base, MS (Maj. Richard Deronndau) 
Lackland Air Force Base, TK (Cora Apollon) 
Langley Air Force Base, VA (Capt. Richard A. Kammeier) 
MacDill Air Force Base, FL (Capt. Richard F. Sellers) 
March Air Force Base, CA (Ma). Arthur L. Johnson) 
Maxwell Air Force Base, AL (Capt. Conrad L. Bush) 
Offutt Air Force Base. NE (Maj. Ralph Miterai) 
Scott Air Force Base, IL (Lt. Thomas B. McQaughy) 
Shaw Air Force Base, SC (Capt. Paul F. Franssen) 
Sheppard Air Force Base, TX (Maj. Gerald N. Black) 
Travis Air Force Base, CA (T/Sgt. Calvin W. Oitsham) 
Westover Air Force Base, MA (Senior M/Sgt. Gene Estes) 



ARMY HOSPITALS 

1st U.S. Army Medical Laboratory, Ft. MePherson, OA 

(Lt. Col. Lowell Larsen) 
4th U.S. Army Medical Laboratory, Ft. Sam Houston, TX 

(Col. Dale Snyder) 
6th U.S. Army Medical Laboratory, Ft. Baker, CA (Col. 

Glenn West) 

Brooke Army Medical Center, Ft. Sam Houston, TX 

(Col. Stuart Chamblin and Henry M. Radeliffe, Jr.) 
Ireland Army Hospital, Ft. Knox, KY (Ma). James McManis) 
Letterman General Hospital, San Francisco, CA (Col. 

Clarke Harding) 
Martin Army Hospital, Ft. Benning, GA (Maj. Julian Coggin) 
Tripler General Hospital, Honolulu, HA (Col. John Hardman) 
Walter Reed Army Medical Center, Washington, DC (Paul 

H. Larsen, M.D. and Col. David Robinson) 
William Beaumont General Hospital, El Paso, TX (Col. 

Donald McNair and Capt. James H. Anschutz) 
U.S. Army Hospital, Ft. Ord, CA (Maj. John Brazinsky) 



MISCELLANEOUS 

American Society of Clinical Pathologists, Chicago, IL 

(Robert M. Gertz) 
College of Health Related Professions, University of Florida, 

Gainesville, FL (David S. Lindberg, Ed.O.) 
McBride Clinic, Inc., Oklahoma City, OK (J. N. Owens, 

M.D.) 

Miami'Dade Junior College, Miami, FL (Elizabeth Lundgren, 

MT(ASCP)) 
William Kelly, Lake Worth, FL 



both Form A and Form B. The tests were reviewed by 
mail by Examining Committee members, and their 
comments were incorporated into the two final printed 
test booklets. 

'••^ 

Norming - Plan One 

Norming involves reporting the test scores of a known 
group of laboratory workers. Such normative scores 
provide a standard against which to measure the scores 
of any Individual candidate. 

Norming proved to be by far the most difficult part 
of developing the Proficiency Examinations for Clinical 
Laboratory Personnel. 

The initial plan was to give a special norming 
administration of the tests in July 1971 to groups of 
laboratory workers designated by tiieir employers, 
according to the specifications of the Subcommittee on 
Pretesting and Norming. 

Motivati(xi remained an uncertainty, but it was hoped 
that an explanation of the project's purposes would 
persuade norming volunteers of the importance of doing 
their best on the tests. 



Participation was sought through the same means as 
had been used for the pretesting in the Spring. 
Assistance was promised by military and civilian 
hospitals and by independent laboratories. 

But a majority of the candidates who had been 
^'volunteered'' by their supervisors did not appear for 
the tests. 

ETS made efforts to locate additional candidates in 
populous areas of the Middle Atlantic States, but no 
more than a few could be found in any one location. 

Thus, after demonstrating a remarkably successful 
method of preparing Proficiency Examinations, the 
project had demonstrated the difficulty of providing 
norms througii special administration of tests to workers 
who could not expect to gain from taking them. 

Another valid way of providing normative data is to 
compile scores of a selected group of candidates taking 
the examinations, and it was to this method ETS and 
NCCML turned to norm Form A of the tests in the Fall 
of 1971. 
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The pOot administrations of the Proflciency Ex- 
aminations in November 1971 and May 1972 are 
described in dnaO in a subsequent section of this report. 
From information included on the registration form, 
ETS selected November 1971 candidates on the tech- 
nician level who had one or two years of laboratory 
training and one to five years of laboratory expeiience. 
Two groups were designated: 

# Group I included 233 technicians who had 
received military training. 

# Group U included 129 candidates trained in 
civilian hospitals. 

Separate scores for each group and scores for the two 
groups combined on Form A of the four tests were 
reported in a Content and Norming boolclet distributed 
in January 1972 to the candidates and to directors of 
S,500 hospital laboratories and 2,800 independent 
laboratories across the country. Tables for the two 
groups showed percentile rankings and mean (average) 
scores. 

These norms were considered ''preliminary/' since 
the groups involved were relatively small and the 
registration form had not been designed speciflcally to 
extract relevant background data about each candidate 
so as to compile a demographic description of the 
norming groups. The tables were reprinted in the second 
Interim Report of the project iu August 1972. Since 
they have now been superseded by more complete 
norming information for Form A, they are not included 
in this report. It is of interest to note, however, that 
they showed the military group scoring from four to 
fourteen points higher than the civilians. 

Norming - Plan Three 

For Form B of the Proflciency Examinations^ given 
first in May 1972, two changes in procedure were made: 
(1) more information was obtained on the candidates 
and their backgrounds, and (2) the decision on which 
candidates to include in the norming sample was made 
by the National Advisory Committee at its meeting in 
June 1972 after reviewing the scores of a wide variety of 
candidate groups. 

A questionnaire was distributed to all candidates at 
the test centers, seeking information on age, sex, 
geographic location, laboratory training, generd educa* 
tion, certification, laboratory experience, job title, and 
present employer. Neariy all the candidates completed 
the questionnaire as requested. 

Educational Testing Service was then able to provide 
detailed score information for candidates with a variety 
of backgrounds - for example, those who had had 702 



months of laboratory training, or 13-18 months, or 24 
months or more; those who had had less than 1 year of 
laboratory experience, on up to those with more than 20 
years; those who had attended CLA schools or junior 
colleges or proprietary schools or militao^ laboratory 
training programs; those whose general education 
stopped at high school, or those who went on to varying 
amounts of college. Mean scores and standard deviations 
for all these various breakdowns were presented to the 
Advisory Committee at its meeting. 

With the data in front of them. Advisory Committee 
members could see which factors appeared to influence 
the scores signiflcantly. They drew the lines to provide 
as large a norming group as possible, and agreed on the 
following as the appropriate ccxnposition of the norming 
groups: 

• Only laboratory technicians with formal lab* 
oratoo^ training below the level of the Medical 
Technologist would be included. 

• Those with seven or more months of training 
would be included, no matter what their ex* 
perience. 

• Those with fewer than seven months of training 
would be included if they had Ave or more years 
of laboratory experience. 

• Scores would be shown separately for civilian* 
trained and military-trained groups, and for the 
two groups combined. 

• Background information on the groups would also 
. be reported. 

The Committee decided not to report information on 
the scores of medical technologists who took the 
Examhiations, although the original recommendation of 
the subcommittee before the tests were completed had 
been to do so. Although there was some doubt when the 
Examining Committees began their work as to the 
differentiation between the bench worker technician 
level and the medical technologist, the finished tests 
proved the Examining Committees had been able to 
make that distinction. Knowledge and skills on the 
working technician level were the subject of the four 
tests. The more complicated supervisory and trouble- 
shooting aspects of riie technologist's work were not 
included. After looking at the tests at hs June 1972 
meeting, the Advisoo^ Committee decided it would be 
inappropriate to publish normative scores achieved by 
medical technologists, since the tests had been designed 
for a lower level. 

A new Norming Data booklet for Form B was 
published in August 1972, following the Committee*s 
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directions. It included the score information and 
background information in Exhibits D and E. 

Again the candidates with military training and 
experience consistently bettered the scores of the 
civilian«trained. 

Norming - Plan Four 

Next step in the norming process was to obtain norms 
for Form A as sound as those which had been developed 
tor Form B. 

It was agreed that candidates taking Form A in 
December 1972 who met the Advisory Committee 
requirements would be selected, and their scores would 



be analyzed in the same way as for the May 1972 
candidates. 

Again a problem developed. As described in the next 
chapter, the number of candidates was smaller than 
expected, and the number meeting the norming criteria 
thus fell far below that necessary for statistical purposes. 

Attention therefore turned back to the large group of 
candidates who had taken Form A the year before. 
Scores published for that group had been considered 
''preliminary** because the norming groups then defined ^ 
were small and the background information on the 
candidates was deemed incomplete or unclear. Both 
problems, it developed, could be overcome. 



SXHmiTD: 

Percentile Distributions-Form B 

Tiie following table .ivs the percentile rankings for tlie norming groups on each of the four tests. 75 was a perfect score. Ttie 
percentiles siiow the percentage of tl)e group getting scores below each possible pair of scores. Thus a €ivilian*trained technician who 
scored 28 in Clinical Chemistry did better than 64% of Group I, and a niUitary^tralned technician who scored 45 in Blood Banking did 
better than 79% of Group H. 
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EXHIBIT e: 

Background information on Norming Groups 

GROUP I — Ul(> 
Civt llarrTrained Technicians 

Ml fnale / 87% female 

under 25 / 28y. 26-35 
107. 36.«*5 / over '♦5 



Sex 
Age 



Geographic Location '♦77c Northeast / 20% South 
30% North Central / 3% West 



Formal Laboratory 
Tral ning 



Type of Laboratory 
School 



General Education 



Degrees 



Job Title 



\% under 7 months 
58% 7-12 months 

13-18 months 
16'/. more than 18 months 

57V. CLA school 

I37u junior col lege 

30% other civilian program 



567, high school 

377 1-2 years col lege 

77^ 3 or more years college 

85i% none / 12% associate 
2/ baccalaureate / ?% higher 

10% trainee 

23/c laboratory assistant 
607 laboratory technician 
U% supervisor/ instructor 
3/- other 



GROUP II — 36'* 
Ml I itaryTrained Technicians 

<^U,% male / 6% female 

32% under 25 / W/C 26-3S 
18% 36-'*5 / 6% over '♦5 

13% Northeast / 38% South 
\U% North Cential / 25% West 
10% Overseas 

6% under 7 months 
3**% 7-12 months 
^5% 13-18 months 
IS% more Chan l8 months 

28% Army 
38% Navy 
3**% ."Ir Force 



32/. high school 

Wl/, i-2 years col lege 

26/ 3 or more years college 

777 none / 6% associate 

15/ baccalaureate / 27 higher 

U% trainee 

3/ laboratory assistant 
6&/ laboratory technician 
7% medical technologisty 
217 supervisor/instructoV 
57 other 



GROUPS I & II 
800 Laboratory Technicians 

53% male / <«7% female 

^♦5% under 25 / 36% 26-35 
36*«*5 / 5% over «*5 

30% Northeast / 29% South 
22% North Central / \U% West 
5% Overseas 

3% under 7 months 

'♦6% 7-12 months 

35% 13-18 months 

16% more than I 8 months 

295( CLA school 
7% Junior col lege 
15%, other civilian program 
1'*% Army 
18% Navy 
17% Air Force 

W/ high school 

3^/ 1-2 years col lege 

177 3 or more years college 

81/ none / 9^/ associate 

9% baccalaureate / 1% higher 

77 trainee 

137 laboratory assistant 
60v: laboratory technician 
37 medical technologist 
137 supervisor/ instructor 
U% other 



Place of Et^loyment 82/ civilian hospital 

77 i nd&pendent laboratory 
2/ mi I i tary instal lat ion 
9/ other 



Exper ienre 



19/ less than 
30/ I to under 
21/ 3 to under 
13/ 5 to under 
6/ 7 to under 
U/ 9 to under 
<4/ 1 1 to under 
2/ 15 to under 
\,\ 20 years or 



I year 
3 years 
5 years 
7 years 
9 years 
It years 
15 years 
20 years 
more 



lUL civilian hospital 
57 independent laboratory 
66/^ military installation 
3% other 

137 less than 1 year 
26/ I to under 3 years 
1 1/ 3 to under 5 years 
137 5 to under 7 years 
7% 7 to under 9 years 
87 9 to under 1 1 years 
10% 1 1 to under IS- years 
7% 15 to urtder 20 years 
57 20 years or more 



^W/ civ i I ian hospi tal 
6/ independent laboratory 
3t4/ military installation 
67 other 



16*!; less than 
28/ 1 to under 
16*^; 3 to under 
137 5 to under 
6/ 7 to under 
6% 9 to under 
7% II to under 
5% 15 to under 
3/ 20 years or 



I year 
3 years 
5 years 
7 years 

9 years 

I I years 
IS years 
20 years 
more 



College background may or may not have been In natural sciences. Job titles were supplied by candidates. No MT (ASCP)s are included. 



Since the Advisory Committee had adopted its new 
broader criteria ^or the norming group, the number of 
candidates coiild be increased. And the project coordi- 
nator made a persnnR^ review of each registration form, 
clearing up what had been uncertainties for ETS 
keypunch operators. Some biographical Information was 
unavailable, but most proved to be solid. 

When the group moeting the new criteria was drawn 
from the candidates who had taken Form A, it was 
found the gfoup^s average experience was longer thaa 



was that of the Form B group, and it had a larger 
percentage of the higher-scoring military-trained tech- 
nicians. In order to minimize these sample differences, 
the scoies for Form A were at)propriately weighted with 
respect to experience and training to produce com- 
parable percentile distributions. 

Exhibit F is the new comprehensive table of 
percentile rankings which has now been widely dis- 
tributed, giving scores on Forms A and B of each of the 
four tests. 
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Accompanying the table were these new instructions 
on how to read the proficiency examinations scores: 
Perfect score was 75. The percentiles 
show the percentage of the group g<»tting 
scores below each possible pair of scores. To 
compare an individual candidate's score with 
these norms, determine which Form the 
candidate toolc, and compare only with the 
colunms for that Form. (Form A was given 
in November 1971 and December 1972, 
Form B In May 1972 and May 1973.) 

First find the candidate's score in the 
left*hand column, then read across to the 
appropriate test column to find the per* 

centage of the4iotmtag^roup4«ho got scores 

below that score. For example, if a candi- 



date has a score of 26 on Form A of the 
Clhiical Chemistry test, the table shows that 
his performance was better than the per* 
formance of 35% of the norming group on 
that test, and that 65% of the norming group 
did as well as or better than he did. Simaarly 
if a candidate has a score of 51 on Form B 
of the Hematology test, his performance was 
better than the performance of 78% of the 
norming group on that test, and 22% did as 
well as or better than he did. 

Average scores and the number of can* 
didate« hi each group are shown at the 
bottom of the columns. 
Circles were drawn as shown hi Exhibit F in an effort 
to make this information as clear as pos^ble. 



eXHIBITF: 

Percentile Distributions-Forms A & B 



Scores 



Ctiflieal Chemistry 



MiGrobiology 



Hemitology 



Form k* 



ForfflB 



Form A* 



FormB 



Form A* 



FormB 



Form A* 



Slood Binkint_ 

Form 6 



74-75 
72-73 
70-71 
S8«9 
66-67 
6465 
62-63 
60«1 

5859 
56-57 
54-55 

inm 

46-47 
44-45 
4243 
4a41 



99.7 
99.S 
99 
98 



97 
95 
93 
91 



■ST 
89 
87 
85 
80 
78 



38-39 75 

36 37 68 

3435 60 

3233 53 

30-31 49 

2829 _JL^ 

c^s 



22 23 
20-21 



23 
18 



1819 


13 


1617 


9 


1415 


6 


1213 


4 


1011 


3 


8 9 


1 


6- 7 


0.3 


4. 5 




2. 3 




0 1 




No. in 




Group 


438 


Average 


32.15 




d 



99.9 
99.8 
99.8 
99.7 

99 
99 

99 

_9L_ 



97 
95 
94 
92 



82 
77 
73 
68 
61 
53 
46 
39 
32 
25 

18 
14 
10 

6 

4 

3 

2 

1 

06 
02 



64 1_^ 
2825 



99.9 

99.2 

98 

98 

97 

96 

92 

90 

87 
86 
81 

68 
64 
59 
51 



43 
38 
33 
29 
25 
23 
20 
18 
14 
12 

9 
8 
6 
3 
2 
2 
I 
1 

0.5 



414 
40.41 



99.9 
99.8 
99.7 



97 
95 

94 
93 
91 



82 
79 
74 
69 
64 

59 
54 
49 
44 
39 
35 
30 
25 
21 
18 

15 
12 
8 
6 
4 
2 
1 
1 
1 

03 



573 
34.89 



99.9 

99.8 

99.4 

99 

99 

96 

95 

91 
88 
84 

69 
59 
52 
44 
38 

32 
26 
20 
16 
13 
10 

8 

6 

4 

2 

1 
1 
1 

0.5 
0.2 



488 
43^51 



99.9 

99.6 

99 

98 

97 



90 



64 
57 
48 
40 

33 
26 
20 
15 
12 

9 

7 

5 

4 

3 

2 
2 
1 

0.6 
0.4 
0.4 
0 

ii 

0.1 



695 
42 39 



98 
98 
98 
97 

% 
95 
92 
90 
88 
21 
83 
78 
74 



62 
58 
53 
48 
44 
39 
35 
29 
24 
20 

17 
13 
10 

7 

4 

2 

0.8 
0.2 



431_ 
""33I9 



99.7 



99 



97 
97 
95 
93 
90 
87 
84 
80 
75 

69 
65 
60 
54 
47 
40 
34 
28 
22 
17 

13 
11 

8 

6 

3 

2 

0.9 
0.7 
0.S 



593 

"32.05 
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Biographical information accompanying ttiis newly* 
published comprehensive table was that shown in the 
third column of Exhibit E. It was noted that the 
weighting of scores for the Form A group with respect 
to experience and training had produced a similar 
distribution so the one biographical summary suffices 
for both norming groups. 

Special Norms 

Two special sets of norms have been prepared, in 
addition to the general norms described above. One 
provided the scores of a group drawn for purposes of 
Medicare officials in assessbig the possible use of 
NCCML's Proficiency Examinations to qualify woilcers 
for Medicare's Technician standard. This effort is 
described in detail in the section on utilization. 

To meet the need for normative data more 
specifically related to known levels in the laboratory, it 
was suggested last Spring that the Examinations be given 
to students completing Associate Degree Medical 
Laboratory Technician programs. 

Directors of these AD-MLT programs were offered 
the opportunity to admhiister the Proficiency Examina- 
tions to their second-year students on May S, 1973 (the 
date of the regular nationwide administration). Of IS 1 
colleges invited to paiticipate, 69 agreed to do so. Each 
college was provided a summary of all scores and a list nf 
scores for its own students. 

The cooperative arrangement allowed MLT students a 
"trial** test in anticipation of the MLT(ASCP) certifying 
exambiation in August. It gave AD-MLT programs a 
comparison of the performance of their own students 
against that of the large group frcxn many other 
programs at the same level. 

Here are the average scores of the graduating MLT 
students who took the tests. As expected, they are lower 



than scores of the over-alt norming groups of working 
technicians: 

Clinical Chemistiy .... 22.2 (657 students/ 

Microbiology 26.8 (647 students) 

Hematology 35.7(671 students) 

Blood Banking 24.3 (646 students) 

These AD-MLT graduates formed a large portion of 
the candidates taking the MLT(ASCP) Registiy examina- 
tion in August. Since the Registiy examination pass/fail 
score is set at one standard deviation below the mean of 
the group taking the test on any one day» it is safe to 
assume that a m^^ority of these students are now 
ASCP^certifled Medical Laboratory Technicians. 

NCCML and ETS have been interested since the 
outset of this phase of the prefect in a possible 
comparison of these Proficiency Examinations scores 
with the August Registry examination performance of 
the same AD-MLT students. A memorandum offering to 
cooperate with the ASCP Board of Registry and the 
MLT Committee in a joint prcject to make this 
statistical comparison was sent by the NCCML Board of 
Directors to the jobit Board meeting of the American 
Society of Clinical Pathologists and the College of 
American Pathologists held in mid-January 1974. In that 
memorandum* NCCML noted the expressed concern of 
members of the ASCP Board of Registty and the CLA 
and MLT Committees about the lack of Proficiency 
Examinations score information for identifiable levels of 
laboratory personnel, and pointed out that the proposed 
comparison could provide such information. NCCML 
and ETS offered to make the Proficiency Examinations 
scores available to the Registry for such a comparison, or 
to do the statistical work \n Princeton at no cost to 
ASCP, whichever might be mote acceptable. The 
proposal was not accepted. 



Today's inflexible and frequently discriminatory require- 
ments of a diploma or a degree in order to be con- 
sidered for a job make little sense. They are quite rightly 
being attacked in the courts. What we need are some 
new systems for finding out whether an individual has 
the specific attributes to perform a particular task and 
the adoption of these systems by both employers and 
schools. 

-HAROLD HOWE II, Vice President, 
Ford Foundation (1972) 
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Test Administration 



The Proficiency Examinations for Clinical Laboratory 
Personnel were administered during tlie pilot year by 
Educational Testing Service under an agreement with 
NCCML. Funding from the Manp 'wer Administration 
under the contract allowed a trial period during which 
candidates could take the tests at no cost. Meanwhile, 
long-term arrangements were to be worked out whereby 
costs for administering the tests were to come from 
candidates' fees. 

Originally, it had seemed possible that the tests could 
be administered by a variety of organizations. Later, 
practical considerations involving test security made 
clear there must be one agency in control. BTS was well 
equipped for the assignment. 

The National Advisory Committee set up the guide- 
lines for this aspect of the project, as it did for the 
others: 

• There were no el^bility requirements. 

• A candidate could take one or more of the four 
tests. 

• A candidate could retake the tests if he wished. 

• Scores were sent only to the candidate or to those 
persons he designated. 

Under the agreement concerning administration of 
the tests, ETS agreed to (1) publish a Buttetin of 
Information for candidates about the examinations; (2) 
set up centers, secure and instruct test supervisors, and 
pay honoraria; (3) print and mail test booklets and 
answer sheets; (4) receive appltoations and produce and 
mail admission tickets; (5) machine score answer sheets, 
and produce and mall score reports; (6) provide test 
analysis and normative information; and (7) arrange all 
procedures to assure test security. 

ETS set up "regular" test centers in 58 cities in 47 
states; the list was included in the Bulletin of Inform' 
tton. In addition, it was agreed to set up a special center 
on request for any candidate in the United States who 
was more than 100 miles from a listed center. And the 
Department of Defense cooperated by agreeing to help 



ETS set up a special test center at any militaty 
installation overseas. 

The tests were scheduled for Saturday mornings. 
When a request came for another test date from a 
candidate whose religious scruples prevented his taking 
the tests on a Saturday, ETS arranged a special 
administration on the following Monday. This option 
has been made available since the second administration 
and is now speciflcally mentioned in the Buttetin of 
Information, 

Registration deadlhies were set four weeks in advance 
of test dates, with another two weeks* lead time for 
requests for specid test centers. 

Candidates were instructed to report to their test 
center, at 8:30 a.m. Bach candidate took only those 
tests he wished, in the order printed in the test booklet. 
An hour was allowed for each test. Those taking only 
one test could leave after one hour; those takhig dl four 
stayed through the entire session. Supervisors received 
comprehensive instructions on every aspect of adminis* 
terhig the examinations, with special procedures to 
assure test security. 



We were Indeed pleased to note the gracious 
responsiveness of your Project organization 
In arranging for a special test date for those 
whose religious scruples prevent their taking 
$he tests on Saturday. I'm sure there will be 
some worthy Individuals who will owe their 
opportunity for career advancement to this 
kindly and thoughtful consideration. 

-A.F. BROWN, M.O., 
Qlendale Adventlst Hospital (1972) 
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There was no way to predict how many candidates 
would take the ProHciency Examinations during the 
pilot year, particularly since the tests were free. For 
funding purposes, NCCML had estimated that 2,000 
candidates might be expected. £TS printed 2,300 test 
booldets just in case. 

Both were underestimates. 

The actual candidate total was 3,577. More than 
2,20U registered to take the tests on November 20, 
1971, and 1,470 candidates actually showed up. And of 
3,130 who registered for the tests given on May 6, 1972, 
2,107 appeared. (Attrition is to be expected for any test, 
and particularly for one which is offered at no charge.) 

Information on the two pilot administrations is given 
in Exhibits G and H. Exhibit G shows how many were 
registered, how many took each of the four examina* 
tions, and how many took only one test, compared to 
those who took more thai one. Exhibit H lists test 
centers and the numbers of candidates at each. 

In November 1971, 118 test centers were established, 
including 21 military bases (IS of them overseas) and 
two prisons in addition to the regular and special civilian 
centers all over the U.S. In May 1972, 163 test centers 
were established, including 34 for military bases (23 of 
them overseas) and eight on ships at sea. Test centers 
were set up in May at three prisons, but the registrants 
did not appear. 

The tests were given in 49 states. Many test centers 



were set up for only one candidate. The largest group 
was the 107 candidates taking the tests at Roosevelt 
University in Chicago in May. 

No insoluble problems developed during the trial 
administration period. 

ETS and NCCML ran out of their supply of 18,000 
copies of the Bulletin of Information and application 
form long before the first deadline. Replacements 
including the most important information and the form 
were hurriedly prepared, and no one was prevented from 
taking the tests for lack of this material. An additional 
40,000 copies of the Bulletin were printed for use in the 
Spring. 

A more serious problem was the failure of three test 
supervisors to show up on November 20 at the 
appointed times and places, leaving candidates to return 
home disappointed. ETS arranged special makeup test 
dates for those candidates a few weeks later. 

Post*PiIot Administrations 

Most of the original arrangements for administering 
the Proficiency Examinations were written into the 
continuing agreement approved by th«i Advisory Com* 
mittee and the Labor Department and entered into by 
NCCML and ETS. NCCML formulates policy under this 
agreement. ETS provides administration of the tests. 
ETS charges a candidates' fee, set by mutual agreement 
and designed to cover expenses. An arrangement for 
revising the tests is included, should fUnds become 
available. The agreement can be terminated by either 
party with a year's notice. 

The 1972-73 fee was set at $25, with the hope that 
2,000 or so candidates per year would make the actual 
test administration self-supporting. Fees would not pay 
the expenses of publicizing the Examinations and 
promoting use of their results by employers and 
agencies, however. 

The fee presents a hardship for some candidates, 
particularly those in the Armed Forces and those in 
prisons. Although sources of support for both groups of 
candidates have been sought, no means of avoiding 
payment by such candidates has been found. 

The number of candidates willhig to pay $25 turned 
out to be a small fraction of those willing to take the 
free tests the year before. For the tests on December 2, 
1972, there were 193 paid registrants, of whom 162 
showed up. (This 16.1% attrition rate has never been 
explained.) There were 58 test centers, of which two 
were abroad and one on a Naval ship. 

(Text continued on page 27.) 
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BXHtBIT H: 

1971*72 Test Centers 



Ttit Cmttr 



No».71 May 72 
(AppliMott/Candidstn) 



ALABAMA 

Birmingham, Samford Univ. 
Dothan, Q. Wallace St. Tech. Jr. Coll. 
Mobile. Mobile Coll. 
Montgomery, Alabama State Univ. 

ALASKA 

Adak, Naval Station 

Anchorage, Anchorage Comm. Coll. 

College, Univ. of Alasica 

ARIZONA 

Phoenix, Phoenix Coll. 
Tucson, Univ. of Arizona 

ARKANSAS 

Little Rocic Univ. of Arlcansas 
CALIFORNIA 

Bakersfield, Bakersfield Comm. Coll. 
Los Angeles, Occidental Coll. 
Riverside, Univ. of California 
San Diego, U.S. Naval Hospital 
San Pranoisco, Univ. of San Francisco 
Travis Air Force Base 

COLORADO 

Alamosa,Adams State Coll. 
Denver, Univ. of Denver 

CONNECTICUT 

Hartford, Trinity Coll. 

DISTRICT OP COLUMBIA 

Washington, Howard Univ. 

FLORIDA 

Fort Myers, Bdison Jr. Coll. 
Jacksonville, Jacksonville Univ. 
Melbourne, Florida Inst, of Tech. 
Miami, Univ. of Miami 
Orlando, Valencia Comm. Coll. 
Pensacola, U.S. Naval Hospital 
Tampa, Univ. of South Florida 

OeORGIA 
Atlanta, Emory Univ. 
Augusta, Augusta Coll. 
Columbus, Columbus Coll. 
Savannah, Armstrong State Coll. 

HAWAII 

Honolulu, Univ. of Hawaii 
IDAHO 

Boise, Boise State Coll. 
Pocatello, Idaho State Univ. 

ILLINOIS 

Bloomington. Illinois Wesleydn Univ. 
Chioago, Roosevelt Univ. 
Ofloatur, Millikin Univ. 



9/ 8 12/ 8 
2/0 

10/ 5 12/12 
17/12 



4/ 4 
4/ 4 

16' 9 
1/ 0 



42/18 
18/11 
21/ 8 
37/20 



26/17 
25/18 
S3/28 

6/ 6 
19/12 

7/ 7 
21/16 

16/ 6 
23/19 

32/20 
9/ 9 
1/ 1 

24/24 
3/ 3 



66/42 
6/ 6 



3/ 3 
4/ 4 

20/14 



22/ 4 10/ 3 



1/ 1 
46/21 

9/ 3 
34/16 
64/33 

7/ 7 

4/ 4 
26/17 

43/32 

71/42 



30/16 
3/ 3 
48/26 
19/13 

10/ 6 

44/32 

10/ 8 
3/ 0 

18/15 

1/ 1 

8/ 6 

3/2 
144/107 



TMt Cantar 

INDIANA 

Port Wayne, Indiana Inst, of Teoh. 
Indianapolis, Butler Univ. 
Michigan City. St. Anthony Hospital 

IOWA 

Cedar Palls. Univ. of Northern Iowa 
Davenport, St. Ambrose Coll. 
Oes Moines, Drake Univ. 
Keokuk, Southeastern Comm. Coll. 

KANSAS ~ 

Cof f ey ville. Cof f eyville Mem. Hosp. 
Dodge City, Dodge City Comm. Jr. C 
Phillipsburg, Great Plains Lutheran Hosp. 
Pittsburg, Kansas State Coll. 
Topeka, Washburn Univ. 
Wichita, Wichita State Univ. 

KENTUCKY 

Henderson. Henderson Comm. Coll. 
Louisville, Univ. of Louisville 
Somerset, Somerset Comm. Coll. 

LOUISIANA 

Baton Rouge, Louisiana State Univ. 
MAINE 

Augusta, Univ. of Maine 
Presque isle, Univ. of Maine 

MARYLAND 

Baltimore, Johns Hopkins Univ. 
Baltimore, Towson State Coll. 

MASSACHUSETTS 
Boston, Northeastern Univ. 
Springfield, American International Coll. 



Nov. 71 May 78 
(Applieantf/CandidatM) 



16/ 7 


1/ 1 


31/21 


39/33 


47/44 


26/26 


4/ 4 




8/ 8 


11/ 6 


9/ 3 


8/ 8 




2/ 2 


1/ 0 




2/ 0 


10/ 4 



30/22 
3/ 3 



17/1 < 



60/47 
12/10 

17/17 
66/61 



49/36 



2/ 2 
20/ 9 



2/ 0 



7/ 3 



1/ 0 
29/24 
2/ 2 



13/ 6 
32/19 
6/ 6 



7/ 3 12/ 8 



MICHIGAN 

Detroit, Univ. of Detroit 
East Lansing, Michigan State Univ. 
Qwinn, K. I. Sawyer Air Force Base 
Houghton, Michigan Tech. Univ. ~ 
Sault Ste. Marie, Lake Superior St. Coll. 1/ 1 

MINNESOTA 

Duluth, Univ. of Minnesota 
Minneapolis, Univ. of Minnesota 

MISSISSIPPI 

Columbus, Columbus Air Force Base 
Jackson, Jackson State Coll. 
Jackson, Millsaps Coll. 

MISSOURI 

Columbia, Univ. of Missouri 
Ft. Leonard Wood, Army Educ. Ctr. 

St. Louis, St. Louis Univ. 49/34 

Springfield, Drury Coll. 17/17 
Warrensburg, Central Missouri St. Coll. 

MONTANA 

Helena, Carroll Coll. 7/ 7 

Miles City, Miles Comm. Coll. 
Wolf Point. Wolf Point High School 



41/30 
21/13 



63/42 

101/63 
37/32 



10/ 9 
47/43 
11/ 0 
1/ 1 



42/31 

2/ 1 
IV 7 



16/16 
77/61 

3/ 2 



16/13 
6/ 6 
1/ 1 
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T«st Center 



Nov. 71 May 72 
(Applicants/Cendidetef) 



t'^st Center 



Nov. 71 Mey72 
(Applioentt/CindidetH) 



NEBRASKA 

Norfolk, Northeastern Nebraska Coll. - 2/2 

North Platte, North Platte Jr. Coll. 3/1 8/7 

Omaha, Creighton Univ. 14/14 25/19 

NEVADA 

Las VegaSi Univ. of Nevada 3/3 8/5 

Reno, Univ. of Nevada 3/2 

NEW HAMPSHIRE 

Concord, Teoh. Inst. 10/10 « 

Laconia, N.H. Voo. Tech. Coll. • 

NEW JERSEY 

New Brunswick, Rutgers Univ. 
NEW MEXICO 

Alburquerque, Univ. of New Mexico 
Roswell, Eastern New Mexico Univ. 
Santa Rosa High School 

NEW YORK 

Albany, SUNY at Albany 
Buffalo, SUN Vat Buffalo 
Griffiths Air Force Base 
New York, City Coll. of N.Y. 
Rochester, Rochester Inst, of Tech. 
Syracuse, Syracuse Univ. 

NORTH CAROLINA 

Asheville, Univ. of North Carolina 
Durham, Duke Univ. 
Greensboro, Univ. of North Carolina 
Qreenvilte, East Carolina Univ. 
Camp LeJeune 

NORTH DAKOTA 

Bismarck, Bismarck Jr. Coll. 
Minot, Minot Air Porce Base 

OHIO 

Cincinnati, Univ. of Cincinnati 
Cleveland, Cuyahoga Comm. Coll. 
Cleveland, Cleveland State Univ. 
Columbus, Ohio State Univ. 
Dayton, Wright*Patterson A.P.B. 
Toledo, Univ. of Toledo 

OKLAHOMA 

Oklahoma City, Oklahoma City Univ. 
OREGON 

Eugene, Univ. of Oregon 7/ 4 

Klamath Palls, Oregon Tech. Inst. 1/ 1 

Portland, Univ. of Oregon ^ 

PENNSYLVANIA 

Altoona, Veterans Adm. Hospital S/ 8 

Philadelphia, Temple Univ. 68/43 1 19/78 

Pittsburgh, Ouguesne Univ. 40/32 102/78 

Williamsport, Lycoming Coli. 40/17 23/18 

RHODE ISLAND 

Providencei Brown Univ. 19/14 35/21 



9/ 9 

70/43 83/58 

12/ 7 14/14 
10/10 
3/3 

21/16 
15/14 

7/5 

70/45 112/69 
3/3 — 
32/24 50/29 

14/ 8 
50/47 
24/10 43/23 
6/3 

21/16 



7/7 7/4 
32/28 

16/16 
45/20 

30/21 

32/17 40/31 
22/10 23/12 
1/ 1 

12/ 6 17/6 

8/ 1 

3/ 0 



SOUTH CAROLINA 
Anderson, T. L. Henna High School 
Charleston, Coll. of Charleston 
Columbia, Univ. of South Carolina 
Greenville, Purman Univ. 

SOUTH DAKOTA 

Rapid City, South Dakota School of 

K/kines & Technology 
Sioux Palls, Augustana Coll. 

TENNESSEE 

Knoxville, Univ. of Tennessee 
Memphis, Memphis State Univ. 
Nashville, Vanderbilt Univ. 

TEXAS 

Abilene, McMurray ColK 

Big Spring, Howard County Jr. Coll. 

Canyon, West Texas State Univ. 

Dallas, Southern Mttthodlst Univ. 

Houston, Univ. of Houston 

El Paso, Univ. of Texas 

Pt. Hood, Army Educ. Ctr. 

Marshall, Wiley Colt./ 

Midland, Midland CdiL 

San AntoniOi Port Sam Houston 

Temple, Temple Jr. Coll. 

Wichita Palls, Midwestern Univ. 

UTAH 

Salt Lake City, Univ. of Utah 
VERMONT 

Montpetier, Vermont Coll. 
VIRGINIA 

Norfolk, Old Dominion Univ. 
Richmond, Va. Commonwealth Univ. 

WASHINGTON 

Oak Harbor, Naval Hospital 
Seattle, Seattle Pacific Coll. 
Spokane. Gonzaga Univ. 

WEST VIRGINIA 
Charleston, Morris*Harvey Coll. 
Philippi, Alderson*Broaddus Coll. 

WISCONSIN 

Appleto-^, Lawrence Univ. 
Eau Claire, Wisconsin State Univ. 
LaCrosse, Wisconsin State Univ. 
Madison, Univ. of Wisconsin 

SPECIAL MONDAY CENTERS 
CALIFORNIA 

Los Angeles, Occidental Coll. 

San Praneisco, Univ. of San Pranoisco 

DISTRICT OP COLUMBIA 

Washington, Howard Univ. 



— 


11/ 7 


20/20 


15/10 




8/ 7 


29/21 






Ol f 




c/ m 


18/18 


10/ 6 


39/22 




7/ 7 


16/14 


1/ 1 


21 2 


1/ 1 




4/ 4 


4/ 3 


68/53 


59/35 


17/10 


16/10 


9/ 7 


25/16 




19/11 


- 


21 2 




21 1 


108/73 


66/53 


2/ 2 




18/14 


187l8 


7/ 7 


28/24 


// 7 


MA/4 A 

29/19 




52/23 


21/17 


36/19 


5/ 4 




64/33 


28/18 


1/ 0 


6/ 2 


3/ 3 


24/18 




3/ 2 




4/ 2 




32/25 


10/10 


20/15 


2/ 2 






21 1 




1/ 1 



1/ 0 




Test Center 



Nov. 71 May 72 
(Applicants/Candidates) 



Test Center 



Nov. 71 M«V72 
(Applieants/Candidates) 



IDAHO 

Boise, Boise State Coll. 
OHIO 

Columbus, Ohio State Univ. 
0R6G0N 

Portland, Univ. of Oregon 



1/ 1 
2/ 2 
4/ 4 



PRISONS 

CALIFORNIA 

San Pedro, U.S. Federal Correctional 

Institution - 1/0 

INDIANA 

Terre Haute, U.S. Penitentiary 2/2 
MINNESOTA 

Sandstone, U.S. Fed. Penitentiary - 1/0 

MISSOURI 

Jefferson City, Mo. St. Penitentiary - 6/0 

Springfield, Medical Center for 

Federal Prisoners 13/ 9 - 



SHIPS AT SEA 

Eight U.S. Navy ships - 9/9 

OVERSEAS 

BELGIUM 

Brussels, International School 1/0 - 

Chievres, Education Center, NSSO - 4/4 

BERMUDA 

Paget, Department of Education - 2/2 
CANAL ZONE 

Balboa, Canal Zone Coll. 4/ ^ 3/1 
CUBA 

Quantanamo Bay, U.S. Naval Base ' 3/3 
ENGLAND 

Alconbury, (USAF> 6/4 
GERMANY 

Berlin, Amerika Haus Berlin ~ 2/0 

Hahn AB, Education Center 3/2 

Landstuhl, Department of Army 69/26 19/19 

Munich, Army Education Center - 1/1 



9/ 4 
1/ 1 
9/ 6 



10/ 7 



2/ 2 



Ramstein AB, Education Center 
Rhein«Main AB, USAP Dispensary 
Weisbaden, USAP Hospital 
Weisbaden, Lindsay Air Educ. Ctr. 
Wuerzburg, Army Education Center 

GUAM 

Agana, Univ. of Guam 
ICELAND 

Kef lavik, U.S. Naval Station 
ITALY 

Brindisi, San Vity USAP Air Station 
San Vito Dei Normanni, Educ. Ctr. 

JAPAN 

Camp Zama, USAH Lab 
Pukuoka City, American Cul. Ctr. 
Iwakuni, Marine Corps Air Station 

KOREA 

Ku Ang Ju AB. Base Educ. Ofc. 
Yongsan. USA Army Educ. Ctr. 

OKINAWA 

Ryuku Islands, USA Kadena Educ. Ctr. 
PEARL HARBOR 

Navy Education & Training Sup. Oet. 

PHILIPPINES 

Luzon, Clark AFB 

PUERTO RICO 

Ponce, Catholic Univ. 

SICILY 

Sigonetia, USNAP Sigonella 
SPAIN 

Madrid, Torrejon AB (USAP) 
TAIWAN 

Taipei, Education Services Ctr. 

THAILAND 
U'Tupao Air Field 

TURKEY 

Izmir, Education Center 
VIETNAM 

Saigon, Vietnamese-American Assn. - 
•Extra applicants showed up on the day of the test^ 



1/ 1 



3/ 3 



11/ 3 



8/ 1 



2/ 2 



4/ 3 
2/ 2 



5/ 2 
1/ 1 



11/11 
1/ 0 
1/ 4» 



3/ 3 
1/ 1 
11/ 0 
B/10* 
1/ 1 
1/ 1 

1/ 1 
1/ 0 

1/ 1 



(Continued from page 24.) 

The second paid admlnistfation on May 5, 1973, saw 
266 candidates taking the tests, out of 318 who had 
registered (16.4% attrition). There were 65 test centers, 
two of them abroad and three on ships at sea. 

Statistics on numbers of tests taken by these 



candidates are shown in Exhibit 1. Exhibit 5 lists the test 
centers. 

Fewer Candidates 

There has been considerable speculation about the 
reasons for the smaller than expected number of 
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candidates the second year. Had the saturation point 
been reached dready with the 3,700 persons tested the 
first year? This surely was not the case* since the recent 
laboratory census conducted by the American Society 
for Medical Teclmology for the Center for Disease 
Contr >l had found 51.8% of all personnel in the nation's 
14,000 laboratories with no formal certification. These 
are the people for whom the Proficiency Examinations 
were designed. 

More likely, a continuing uncertainty about specific 
results attainable by taking the Proficiency Examina* 
tions seemed to be responsible for the lower numbers. 
Such examinations are a new phenomenon* Both 
employers and laboratory workers need more informa* 
tiqn on how the test scores can be used in placement 
decisions, and more assurance that the tests are a useful 
and valuable tool for that purpose. Tying the Examina* 
tions into existing credentialhig systems would make 
these points easier to realize. Efforts to achieve such 
tie*ins and to explahi and publicize use of the tests are 
described in followhig sections. 

With the smaller number of candidates, the carrying 
expenses of the Proficiency Examinations for Clinical 
Laboratory Personnel outstripped the candidates* fees, 
and in June 1973 ETS asked for and received permission 
from NCCML to cut the number of administrations to 
one per year. The new date is the first Saturday of 
March» starting with March 2, 1974. 



SXHiBITI: 

1972*73 Administrations 





Deo. 2, 


Mays, 






1972 


1973 


Total 






* 

' 318 


511 




. . . . 162 


266 


4:28 






52 


83 






16.4% 


16.:2% 




... 58 


65 


111 


Candidates taking: 










... 118 


214 


;}32 






179 


268 






166 


236 




82 


183 


266 


Candidates taking: 














4 




73 


77 


180 






36 


55 




16 


19 


35 




50 


134 


184 



EXHIBIT J: 

1972*73 Test Centers 



Dm. 72 May 73 
Test Center <Applioants/Cindidstes) 

ALABAMA 



Birmingham, Samford Univ. 


3/3 




ALASKA 

College, Univ. of Alaska 




2/ 2 


ARIZONA 

Phoenix, Phoenix Coll. 


1/ 1 




Little Rock, Univ. of Arkansas 




2/ 1 


CALIFORNIA 

LOS Angeies, univ. ot southern cai. 
San Francisco, Univ. of San Francisco 


6/ 4 
2/ 1 


3/ 4 
3/ 3 


i^Ai AD Ann 

Denver, Univ. of Denver 


- 


1/ 1 


CONNbUTICUT 
Hartford, Trinity Coll. 


- 


10/ 9 


DISTRICT OP COLUMBIA 

Washington, Howard Univ. 


3/ 3 


9/ 6 


FLORIDA 

Coral Gables, Univ. of Miami 
Jacksonville, Jacksonville Univ. 
Orlando, Valencia Comm. Coll. 
Tampa, Univ. of South Florida 


2/ 2 
21 2 
V 0 


2/ 2 
5/ 3 

2/ 1 


GEORGIA 

Atlanta, Bmory Univ. 
Columbus, Columbus Coll. 


5/ 2 
5/ 5 


3/ 1 
1/ 1 


HAWAII 

Honolulu, Univ. of Hawaii 


— 


1/ 1 


ILLINOIS 

Chicago, Roosevelt Univ. 


12/ 9 


11/ 7 


INDIANA 

Indianapolis, Butler Univ. 
Michigan City, St. Anthony Hospital 


1/ 0 


21 2 
30/31 


IOWA 

Cedar Falls, Univ. of North Iowa 
Davenport, St. Ambrose Coll. 
Des Moines, Drake Univ. 


1/ 1 
1/ 1 


3/ 3 


KANSAS 

Dodge City, Dodge City Comm. Coll. 
Independence, Independence Comm. 

Jr. Coll. 
Topeka, Washburn Univ. 


2/ 1 

4/ 3 
1/ 1 


1/ 1 
8/ 8 


KENTUCKY 

Louisville, Univ. of Louisville 


1/ 0 


1/ 1 


LOUISIANA 

Baton Rouge, Louisiana State Univ. 


2/ 1 


1/ 1 


MAINE 

Augusta, Univ. of Maine 
Presque Isle, Univ. of Maine 


71 6 


8/ 5 
21 2 
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Om.72 May 73 
TattCtnttr (Appiicants/CandidatM) 

MARYLAND 

Baltimore, Towson State Coll. 1/1 7/7 

Salisbury, Salisbury State Coll. - 1/1 

MASSACHUSETTS 

Boston, Northeastern Univ. 4/4 11/9 
MICHIGAN 

East Lansing, Michigan State Univ. 13/10 10/ 8 
MINNESOTA 

Hibbing, Nibbing High School - 1/1 

Minneapolis, Univ. of Minnesota 2/0 6/3 

MISSISSIPPI 

Jaclcson, Jaclcson State Coll. 1/1 - 
MISSOURI 

St. Louis, St. Louis Univ. 5/ 3 6/6 
Warrensburg, Central Missouri St. Univ. 1/1 

MONTANA 

Helena, Carroll Coll. 1/1 4/4 

Miles City, Miles Comm. Con. 1/1 

NEBRASKA 

North Platte, North Platte Jr. Coll. - 1/1 

Omaha, Creighton Univ. 1/1 - 

NEVADA 

Las Vegas, Univ. of Nevada - 1/1 
NEW HAMPSHIRE 

Wolf eboro, Brewster Academy 1/1 
NEW JERSEY 

New Brunswick, Rutgers Univ. 3/0 6/ B 
NEW MEXICO 

Albuquerque, Univ. of New Mexico 4/3 - 
NEW YORK 

New Yoric, City Coll. of N.Y. 10/ 7 

New York, New York Univ. - 18/12 

Potsdam, State Univ. Coll. - 1/1 

Syracuse, Syracuse Univ. 1/0 6/6 

NORTH CAROLINA 

Payetteville, Payetteville St. Univ. - 1/1 

Greensboro, Univ. of North Carolina 2/2 4/4 

Plymouth, Plymouth High School 2/2 

NORTH DAKOTA 

Dickinson, Dickinson State Coll. 1/1 - 
OHIO 

Cleveland, Cuyahoga Comm. Coll. 22/22 13/ 9 

Columbus, Ohio Stats Univ. 6/ B 4/4 

OKLAHOMA 

Oklahoma City, Oklahoma City Univ. - 1/0 
OREGON 

Lakeview, Lakeview High School - 1/1 



Test Canter 



Deo. 72 May 73 
(Applicants/Candidates) 



PENNSYLVANIA 

Philadelphia, Temple Univ. 
Pittsburgh, Ouquesne Univ. 

RHODE ISLAND 

Warwick, Rhode Island Jr. Coil. 

SOUTH CAROLINA 
Charleston, Palmer Coll. 
Columbia, Univ. of South Carolina 

TENNESSEE 

Knoxville, Univ. of Tennessee 
Nashville, Vanderbilt Univ. 

TEXAS 

Canyon, West Texas State Univ. 
Dallas, Southern Methodist Univ. 
El Paso, Univ. of Texas 
Houston, Univ. of Houston 
San Antonio, Pt. Sam Houston 

UTAH 

Salt Lake City, Univ. of Utah 
VERMONT 

Montpelier, Vermont Coll. 
VIRGINIA 

Richmond, Va. Commonwealth Univ. 

WASHINGTON 

Seattle, Seattle Pacific Coll. 

Spokane, Gonzaga Univ. 

WEST VIRGINIA 

Charleston, Morris-Harvey Coll. 

WISCONSIN 

Green Bay, Univ. of Wisconsin 
La Crosse, Univ. of Wisconsin 

WYOMING 
Casper, Casper Coll. 

SPECIAL MONDAY CENTER 
CALIFORNIA 

Los Angeles, Univ. of Southern Calif. 
OVERSEAS 

GERMANY 

Landstuhl, Department of the Army 
CAROLINE IS. 

Koror-Palau-West, Dept. of Education 
TAIWAN 

Pacific, 374th Combat Support Group 

SHIPS AT SEA 

Pour U.S. Navy ships 



18/11 
21 0 

2/ 2 

21 2 



3/ 2 
1/ 1 

1/ 1 
6/ 6 
1/ 0 

1/ 1 



8/ 3 

2/ 2 
1/ 1 



3/ 3 



1/ 0 



1/ 1 



2/ 2 



46/43 
17/16 

1/ 1 

1/ 1 
1/ 1 

3/ 2 
3/ 2 



12/10 
1/ 1 
1/ 1 



1/ 0 
4/ 1 
1/ 1 
4/ 2 

1/ 1 
8/ 7 

1/ 1 



1/ 1 
2/ 2 



1/1 3/3 
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Information Dissemination 



Word about the ProHciency Examinations has been 
spread far and wide in the laboratory Held, through 
articles, press releases, mailings, posters, speeches and 
exhibits. Dramatic proof that the message was getthig 
through came when the number of candidates for the 
pOot year's tests far exceeded anticipations. Evidence is 
less clear now that potential candidates must pay for the 
Examinations ^d are still uncertain what difference 
taking the tests can mean to them. 



Articles 

The NCCML newsletter, GIST, carried the first 
detailed explanation of the PreHciency Examinations 
project in November 1970. Since that time, special 
articles have appeared in: 

Laboratory Medicine, published by the American 

Society of Clinical Pathologists 
The Pathologist, published by the College of 

American Pathologists 
ASM News, published by the American Society for 
Microbiology 

ainical Chemistry, published by the American 

Association of Clinical Chemists 
Lab World, an independent journal 
Medical Laboratory Observer, an independent journal 
Medical Lab, an Independent journal 
Modern Hospital, an independent journal for hospital 

administrators 
Career Mobility Profiles, published by the American 

Hospital Association 
Comprehensive Health Services Career Development 

Technical Assistance Bulletin of the National 

Institute for New Careers 
Operation MEDtHC newsletter of the DOD-HEW- 

sponsored program for counselbig medical corps* 

men into civOian health careers 
Manpower, the magazine of the Manpower Admin- 
istration 

^CCMVs Annual Reports (ot 197a71, 1971-72, and 

the 20 Year Report published in 1973 
Press releases announcing the start of the project and 
each of the test dates have been widely used in 



laboratory and other health-related publications and in 
the military press. Progress Reports and two larger 
Interim Reports on the project have gone to a mailing 
list of nearly 300 interested persons and organizations. 

The final summation of information on the Pro- 
ficiency Examinations appeared in the December 1973 
GIST, with a circulation of 25,000. 

Professional Meetings 

The Proficiency Examinations project has been the 
subject of formal and informal presentations at 
professional meeibigs. The formal presentations, in 
chronological order, have been: 

June 1971 - Albert M. Serling, who directs the 
College-Level Examination Program (CLEP) at Edu- 
cational Testing Service, spoke about the Equivalency 
and Proficiency Exambiations at the annual meeting 
of the American Society of Medical Technologists. 
(Relationship of the Proficiency Examinations 
project to tandem development of Equiv^ency 
Examinations is discussed in the next chapter.) 

Jufy 1971 - Frank J. Fornoff,Ph.D., chairman of 
the ETS Science Department, explained the proce- 
dures involved in developUig the Proficiency Ex- 
aminations at a conference on ^^Career MobUity** 
sponsored by the American Hospital Association. 

October 1971 - At the ASCP Commission on 
Medical Technology meethig held in connection with 
the annual joint meeting of the American Society of 
Clinical Pathologists and the College of American 
Pathologists, a m^or presentation on the Proficiency 
and Equivalency Examinations took place. Partici- 
pants were Loula Woodcock, MT(ASCP), co-chairman 
of the National Advisory Committee for the Pro- 
ficiency Examinations; A. Wendell Musser, M.D., 
chairman of the National Advisory Committee for the 
Equivalency Examinations (and also a member of the 
Proficiency Examinations Advisory Committee); Jack 
N. Arbollno, executive director of the Collese-Level 
Exambiation Program, of which the Equiv^ency 
Examinations are part; and Frank J. Fornoff, PhD.» 
of ETS. 

October 1971 - Albert M. Serling of CLEP spoke 
to a Seminar on Equivalency Examinations sponsored 
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by the Maryland Hospital Education and Research 
Foundation. Jean D. iinehan, NCCML coordinator 
for the Proficiency Examinations project, beaded a 
discussion task force. 

November 1971 - Frank J. Fornoff, Ph.D., of 
ETS manned a "round table" on Equivalency and 
Proficiency Examinations at the annual meeting of 
the Association of Schools of Allied Health Profes- 
sions. . 

December 1971 - Peter G. Loret, director of 
program services in the ETS California office, spoke 
on "Equivalency and Proficiency Examinations for 
Clinical Laboratory Personnel" at the American 
Vocational Association meeting. 

February 1972 - A. Wendell Musser, M.D., spoke 
on "Equivalency and Proficiency Testing Related to 
the Medical Laboratory Field" at the meeting of the 
Federation of State Medical Boards. 

April-June 1972 - Proficiency and Equivalency 
Examinations were explained to junior and senior 
college medical laboratory educators at a series of five 
regional workshops sponsored by the Board of 
Schools of Medical Technology. Speakers included 
Loula Woodcock, MT(ASCP); Clarence R. Jones, 
MLT(ASCP), also a member of the National Advisory 
Committee; and representatives of ETS. 

My 1972 ~ A. Wendell Musser, M.D., spoke on 
"Equivalency and Proficiency Testing" at the 
national convention of the American Medical Tech- 
nologists. ..^ „ . 

October 1972 - A. Wendell Musser, M.D., Frank 
J. Fornoff, Ph.D., of ETS, and Jean D. Linehan of 
NCCML described development of the Examinations 
at a meeting of the AMA Subcommittee on Equiv- 
alency and Proficiency Examinations, bringing to- 
gether representatives of all the allied health fields 
then eng^ed in development of such examinations. 

November 1972 - Jean D. Linehan of NCCML 
spoke on the Examinations at the 20th anniversary 
meeting of the Intersoclety Committee on Health 
Laboratory Services, a group representing all agencies 
and organizations concerned with clinical laboratory 
personnel standards. 

November 1972 - A. Wendell Musser, M.D., 



Judging from the material which comes to 
our office, the medical laboratory 
field Is a leader among health occu- 
pations In attempting to test for 
proficiency rather than restrict prac- 
titioners to arbitrary (and sometimes 
capricious) standards. 

-Health Careers, Maryland Hospital 
Education & Research Foundation (1971) 



chaired a panel arranged by NCCML to discuss 
Proficiency and Equivalency Examinations in allied 
health fields at the meeting of the Association of 
Schools of Allied Health Professions. Other panelists 
were William R. Bishop, Ph.D., of the American 
Medical Association, Harry M. Gerlach of the College 
Entrance Examination Board, and Daniel R. Thomas 
of the American Hospital Association. 
December 1972 - Clarence R. Jones, MLT(ASCP), 

Presented to the State of Illinois Health Care 
icensure Commission a paper on "Equivalency and 
Proficiency Testing in Relation to Licensure and 

Certifleation^f Health Personnel.^^ — 

October 1973 - A. Wendell Musser, M.D., and 
Clarence R. Jones, MLT(ASCP), spoke on "Equi- 
valency and Proficiency Examinations," respectively, 
at a Training Institute sponsored by the Association 
of Schools of Allied Health Professions. 

Informal discussions about the Proficiency Ex- 
aminations have been held at other meetings attended by 
the Committee members and by NCCML staff, deluding 
the May 1971 HEW meeting on licensure of health 
personnel which led to publication of the HEW 
Secretary's Report to Congress on "Licensure and 
Related Health Personnel CredentlaUng"; a conference . 
on certification of allied health personnel held by the 
Association of Schools of Allied Health Professions In 
September 1971; meetings of the National Health 
Council and the AMA Council on Medical Education; 
the First National Conference of Operation MEDOiC in 
March 1973; and professional meetings of pathology and 
related organizations. 

Exhibiis 

A handsome exhibit entitled "Stepping Stones to 
Medical Laboratory Careers" was prepared and shown at 
a score of professional meetings to emphasize the career 
ladder now existing In the laboratory field, and the 
proficiency examinations as a way of stepphig onto that 
ladder at an appropriate rung. The meetings where the 
exhibit has been shown, accompanied by NCCML staff 
members who have reported great interest from meeting 
participants, were: 

October 1971 - American Society of Oinlcal 
Pathologists and College of American Pathologists 

November 1971 - Association of Schools of 
Allied Health Professions 

March 1972 ~ American Personnel and Guidance 
AssocidtioH 

April 1972 - National Science Teachers Assocla- 

^^pril 1972 - American Society for Microbiology 
August 1972 - American Health Congress (spon- 
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I cannot leave my discussion of medical 
technology affairs without mentioning 
the superb job done by NCCML under the 
leadership of Tom Peery In the develop- 
ment of proficiency and equivalency 
examinations. We have high hopes that 
these tests will provide employers 
and academic institutions with useful 
tools t^ evaluate the competency, 
proficiency and attainments of those 
returning from active military life. 

-ELMER R. JENNINGS, M.D., 
President, American Society of 
Clinical Pathologists (1971) 



sored by the American Hospital Association and 
other hospital organizations) 

Atigust 1972 - American Association of Oinical 
Chemists 

Atigust 1972 - American Association of Blood 
Banks (Literature accompanied by NCCML staff, but 
not the exhibit, which was still in transit from the 
AACC meeting.) 

October 1972 ~ National Association of Biology 
Teachers 

February 19/3 - American Personnel and 
Guidance Association 

March-April 1973 - Nati«ial Science Teachers 
Association 

March 19V - Association for the Advancement 
of Medical Instrumentation (Literature accompanied 
by NCCML staff, but not the exhibit, which was en 
route to NSTA meeting.) 
Mio^ 1973 - American Society for Microbiology 
July 1973 - American Association of Clinical 
Chemists 

Auffist 1973 - American Health Congress 
Mailings 

During the three and one-half years of the Proficiency 
Examinations Project, NCCML has developed a variety 
of mailing lists to reach those interested in the 
Examinations - employers who might use them, civilian 
and military laboratory workers who might benefit from 
them, laboratory schools which need to keep abreast of 
career developments, and interested individuals and 
organizations in other allied health fields. An important 
portion of the mailing list consists of organization and 
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institution staff members who have speciHcally re* 
quested information about the Examinations, having 
learned of them through the other publicity methods 
used. 

Six major mailings have been sent during this period 
- an initial letter explaining the project and Ave other 
mailings timed in anticipation of the administrations cf 
the Proficiency Examinations. Test announcement mail- 
ings have included copies of the Bulletin of Information 
for candidates, posters ior bulletin boards, and norming 
data. Separate releases, memoranda or letters went to 
each type of recipients. The mailing list includes: 

5371 laboratories in civilian hospitals approved by 
the Joint Commission on Accreditation of 
Hospitals 

1487 laboratories in additional civilian hosphals 

approved for reimbursement under Medicare 
164 laboratories in Veterans Administration hos- 
pitals 

230 laboratories in mllhary hospitals 

2440 independent laboratories approved for reim- 
bursement under Medics ; 

1731 educators of medical laboratory personnel: 
773 schools of medical technology 
181 associate degree medical laboratory techni- 
cian programs 
2 16 certified laboratory assistant schools 
105 cytotechnology schools 
456 medical technology coordinators in bac- 
calaureate degree colleges and universities 

1200 organizations which have specifically requested 
information on Proficiency Examinations 
50 state public health laboratories 
1 20 heahh careers and hospital organizations 
1 20 individuals and agencies responsible through 
Operation MEDIHC for counseling returning 
medical corpsinen on opportunities hi the 
civilian health fields. (Nearly half are path- 
ologists specifically appointed by ASCP to work 
with this effort.) 
550 press list and Progress Reports list 

In addition, nearly 2,500 individual laboratory 
workers have requested information on the examina- 
tions. These individual names were retained on the 
mailing list to receive at least two of the major mailings. 
Information also has gone to candidates from prior 
administrations who might tell theh co-workers about 
the tests - or be interested in retaking the tests 
themselves. 

There has also been a heavy flow of mail requhring 
individual replies. Some tetters come from employers 
asking about possible uses of the tests in hiring or to give 
merit promotions and raises. Many other letters come 



from laboratory workers with years of experience, often 
some training, and, they feet, little to show for it. They 
have heard that means are available for them to get some 
recognition, and they want information and advice. 



Reaching Military Corpsmen 

Several special methods have been developed to reach 
present and former military laboratory specialists with 
the information that Proficiency Examinations are now 
available to help them transfer their training and 
experience to the civilian laboratory field at an 
appro\>riate level. 

Word that both Proficiency and Equivalency Ex- 
aminations were being developed was included by 
NCCML in a brochure showing parallel military and 
civilian laboratory career ladders and encouraging up- 
ward movement on them. 

Military laboratory directors, from those in the 
Suigeon Generals' offices and the Armed Forces 
Institute of Pathology to those in the field, have been 
cooperative in distributing information to some 1,750 
laboratory personnel throughout the world. Press offices 
at the Department of Defense have assured wide use of 
news releases in military publications. 

The DOD Transitional Manpower Program, respon- 
sible for helping military personnel nearing the end of 
their service, has distributed Proficiency Examinations 
literature before each test administration to its Transi- 
tion Offices at some 500 bases in this country and 
abroad. 

NCCML has helped to set up and staff a network of 
resource people who can be helpful in distributing 
information on the Proficiency and Equivalency Ex- 
aminations in a personal way to returning military 
corpsmen. This network consists of more than SO 
pathologists appointed by the American Society of 
Clinical Pathologists to work with Operation MFDIHC. 
MEDIHC (Military Experience Directed Into Health 
Careers) is a joint effort of the Department of Defense 
and the Department of Health, Education, and Welfare 
to identify medical corpsmen before their separation 
from the services and to counsel them into civilian 
health careers. Each of the ASCP-appointed pathologists 
has agreed to assist a state MEDIHC agency in counseling 
military laboratory specialists into jobs and/or further 
training in the civUian laboratory field. NCCML has kept 
these counselors informed of career developments in the 
laboratory field - including the Proficiency and Equiv- 
alency Examinations - through a series of intermittent 
memoranda. 



It should be practicable for people to come 
into the health care system from diverse 
backgrounds and to demonstrate qualifica- 
tions equivalent to those acquired through 
formal education. ... In evaluating the 
individual health worker, the emphasis should 
be on the abilitv to perform necessary func- 
tions rather than fornr al educational ac- 
complishments; that U, the focus should be on 
outputs-on worker prof iciency-instead of 
inputs-formal course work completed. 
Proficiency tests are one device to accom- 
plish this assessment. 

-Final Report, Project VEHTS- 
Versatile Employment for 
Health-Trained Servicemen (1973) 
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Equivalency Examinations 



The Proficiency Examinations for job placement were 
planned in tandem with a related project - development 
of Equivalency Examinations for academic credit in the 
same four clinical laboratory fields. 

The Equivalency Examinations were also prepared by 
Educational Testing Service. They were funded by the 
' NiH Division of Allied Health Manpower, to become 
part of the College-Level Examination Program (CLEP) 
of the College Entrance Examination Board.. 

The two test development projects have been 
coordinated through some overlap of membership on 
their advisory conmiittees, through science staff mem* 
bers at ETS who have worked on both tests, and through 
NCCML publicity efforts, which have mentioned both 
projects and differentiated between their purposes, 
— NCCML-staff members were instrumental in initiating 
the Equivalency Examinations effort, and have been 
involved in the project in an unofflcial supportive role 
since it began in July 1970. The NCCML-Manpower 
Administration contract for the Proficiency Examina* 
tions Project included an agreement to promote both 
sets of examinations. 

NCCML has pointed out before audiences and in 
print that the examinations differ in three ways; 

• In their specifications: The Proficiency Examina- 
tions were developed from lists of tasks, the 
Equivalency Examinations from course outlines. 

• In the groups on which they were normed: The 
Proficiency Examinations were normed on those 
working in clinical laboratories, the Equivalency 
Examinations on students just completing the 
appropriate courses. 

• In their purposes and use: The Proficiency 
Examinations are for job placement, the Equiv- ' 
alency Examinations for academic course credit in 
baccalaureate Medical Technology and associate 
degree Medical Laboratory Technician programs. 

As the only professional organization in the 



laboratory fleld specifically committed to publicizing 
both projects aiod explaining their different functionSi 
NCCML has tried where possible to mention both 
projects at the same time. Actually, the concurrent 
development of both projects has, on balance, made it 
easier to explain the very different specific purposes of 
each one - both leading to the general mutual purpose 
of providing appropriate recognition and upward 
mobility for military laboratory specialists in particular, 
and laboratory workers in general. 

In addition to mentioning the Equivalency Examina* 
tions in most Proficiency Examinations promotion, 
NCCML staff worked specifically with«^College Board 
staff on a joint brochure and a promotional mailing for 
the CLEP examinations in the Spring of 1973. 

The Tests 

There are four CLEP Equivalency Examinations in 
laboratory subjects: one for undergraduate Microbiology 
and three for the clinical subjects. Clinical Chemistry, 
Hematology, and Immunohematology. Each is a 
90-minute paper-and-pencil test, with an optional essay 
test. 

Like other CLEP tests, the Equivalency Examinations 
are given once a month at test centers across the 
country. The fee for taking them is $15 apiece. There 
are no eligibility requirements. 

With the cooperation and encouragement of the 
Board of Schools and the American Society for Medical 
Technology, ETS was able to secure help from schools 
of medical technology and colleges across the country to 
norm these four examinations on several thousand 
sttidents just completing the courses involved. The Board 
of Schools'^ Newsletter published the resulting nor* 
mative data which gives the average scores achieved by 



'''Now National Accrediting Agency for Clinical Laboratory 
Sciences. 
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students who subsequently received "A," "B," "C," and 
"D" grades in the respective courses. The CLEP program 
generally suggests colleges award credit to candidates 
who score at least the average of the "C" students in the 
norming group. 

Acceptance 

Decisions on use of the test scores to grant credit are, 
of course, a matter for the individual colleges and 
universities. Other CLEP exan^nations are accepted for 
credit purposes by more than 1,400 colleges. 

To learn whether laboratory educators have decided 
to use the tests for credit purposes, and to stimulate 
those still on the fence to give the matter thought, 
NCCML recently conducted a promotional survey on 
granting of credit for trainhig/experience in the 
laboratory field. Questionnaires went to four types of 
institutions: (1) AMA«approved Schools for Certified 
Laboratory Assistants, (2) colleges offering associate 
degree Medical Laboratory Technician programs, (3) 
AMA«approved hospital Schools of Medical Technology, 
and (4) colleges or universities offering baccalaureate 
degree Medical Technology programs (usually in con* 
junction with the preceding group of hospital schools). 

Returns as of January 31 indicate that at least 81 
programs above CLA level now use the CLEP exams, and 
more than 130 are studying their use. Other preliminary 
survey results include the following: 

Of 69 CLA schools replying, 10 have granted credit 



I believe that nothing should Inter- 
fere with the right of an educational 
institution to grant its appropriate 
degree. But the time has come for these 
institutions to reconsider in depth 
their methods of granting credit. 
The institutions of higher education 
apparently are holding back from taking 
a leadership role in recognizing and 
utilizing equivalency examinations to 
grant credit for knowledge acquired 
in other than the formal manner. This 
is not only very disappointing but it 
is incongruous with the advances made 

in other fields. 
-A. WENDELL MUSSER, M.D., 
Chairman, Equivalency Examinations 
Advisory Committee (1973) 



for experience to incoming students; 26 have had 
graduates accepted with credit in MLT or MT programs. 

Of 92 AD'MLT programs replying,, 49 have policies 
for granting credit; 34 use CLEP exams, and 31 use local 
tests to award credit; 27 require a demonstration of 
performance as well. Of 41 programs studying credit 
policies, 36 expect to use CLEP exams. 

Of 216 MT repUes, 17 grant credit and 75 are 
studying such policies. Eight now use the CLEP exams, 
57 others expect to do so. 

Of 176 colleges replying, 53 have policies for granting 
credit. To award credit, 39 use the CLEP tests. Of 59 
colleges studying credit policies, 41 expect to use CLEP. 
Some also use or plan to use performance tests. 

Many in the last two groups would prefer to let 
someone else solve the problem of granting credit. A 
number of MT schools say they would have to defer to 
the colleges on this matter. Many colleges counter by 
indicating this would be up to the clinical schools. 

NCCML is preparing the information on present 
policies in directory form for publication in Laboratory 
Medicine, the ASCP monthly. 



External Degrees 

Another way in which the CLEP medical technology 
examinations can help laboratory workers gain appro, 
priate credit is through the new External Degree 
programs offered by the the Regents of the State of New 
York and by Thomas A. Edison College in New Jersey. 
New York began in 1972 to offer an associate degree to 
candidates who could amass sufficient credit through 
courses taken at civilian and military Institutions, 
examinations such as those of CLEP, and evaluation of 
life experiences. The New Jersey degree follows a similar 
pattern. The New York program will grant six credit 
hours for each of the CLEP laboratory examinations in 
clinical fields, and three credit hours for the CLEP 
Microbiology test. Candidates need not be New York 
residents or even come to the state to be eligible for the 
degree. 

For laboratory workers who have CLA(ASCP) cer* 
tiflcation, who went through a fulhyear military 
laboratory course, or who have five years of varied 
laboratory experience, an associate degree or the 
equivalent is the key to upward mobility via 
MLT(ASCP) certification. NCCML has promoted this 
new opportunity, and since the New York program 
began, at least 21 laboratory workers have qualified for 
the MLT(ASCP) examination by obtaining an External 
Associate Degree. 
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Utilization 



Unly a few months after the Proficiency Examinations 
Project started^ NCCML began to look ahead to ways 
this new tool could be used when it was ready. In 
November 1970» a Subcommittee on Utilization was 
convened^ with the following members*: 

Joe M. Blumberg» M.Dm Major General, USA (Ret.), 
Co-Chairman of the Proficiency Examinations 
project. 

Lt. Col. Robert C. Barnum, USA, MEDIHC Coordi- 
nator» Transitional Manpower Program, DOD 

Lt. Col. James L. Black Jr., USMC, Educational 
Programs and Manpower Training, DOD 

Sylvia Blatt, Chief, Division of Laboratory Improve- 
ment. Department of Health of the City of New 
York 

Howard L. Bodily, Ph.D.,Chief, Laboratory Services, 

California State Health Department 
Dee DePaoli, Educational Program Development 

Branch, NIH Division of Allied Health Manpower, 

HEW 

Sp/6 Robert Dowell, 1st Army Area Medical 

Laboratory, Fort George G. Meade 
Aldo J. Facca, Division of Health Standards, HEW 
Donald F. Foy, Manpower Resources Branch, NIH 

Division of Allied Health Manpower, HEW 
Marvhi France, RMT, Gradwohl School, St. Louis 
Harold I. Lewack» Division of Program Development 
and Legislative Services, Manpower Adminis- 
tration, DOL 

Clarence R. Jones, MLT(ASCP), Faith Hospitals, St. 
Louis 

Barbara C. Nagel, Division of Health Standards, HEW 
Martha PhiUips, M.S., MT(ASCP), Chief of Allied 

Health Training, Veterans Administration 
David A. H. Roethel, Executive Director, American 

Association of Clinical Chemists 
Wellington B. Stewart, M.D., Commissioner of 

Medical Technology, American Society of CUnical 

Pathologists 

Edwin A. Williams, Veterans Employment Service, 
DOL 

The Subcommittee considered questions of how the 



^Titles are those held at that time. 



Proficiency Examinations could be administered, pro- 
moted and utilized to break down barriers to upward 
mobility for laboratory workers. Participants suggested 
that use of the BxanUnations by employers to hire and 
place personnel could be enhanced and encouraged by 
working to tie the tests in with existing credentialing 
structures - certification, licensure, and governmental 
personnel qualifications under civil service and Medicare 
regulations. NCCML efforts since that meeting have 
followed these suggestions, with some successes and 
some failures, as noted in the sections which follow. 

Endoisements 

NCCML asked the major professional associations of 
laboratory employers in 1971 to endorse use of the 
* Proficiency Examinations for job placement purposes, 
and all of them have done so: the American Society of 
CUnical Pathologists, the College of American Path- 
ologists, the American Academy of Microbiology, the 
American Association of Clinical Chemists, the 
American Association of Blood Banks, and the American 
Hospital Association. 

Certification 

Laboratory workers who complete training programs 
accredited by the American Medical Association can 
obtain national certification through the Board of 
Registry of the American Society of Clinical Path- 
ologists. More than 120,000 of them have been 
examined and certified by this group shice 1928. There 
are three certifiable levels of laboratory generalists: 

Certified Laboratory Assistant - CLA(ASCP) - with 
one year of post*high school vocational laooratory 
training or with training and experience in the 
military laboratory system. 

Medical Laboratory Technician - MLT(ASCP) - an 
associate degree level, requiring two years of 
college credit plus or including laboratory training 
(civilian or military) and/or experience. 
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Medical Technologist - MT(ASCP) - the bac- 
calaureate degree level, including AMA«approved 
year-long clinical training or five years of labor- 
atory experience. 

In more recent years, two other registries for 
laboratory po'sonnel have evolved. These are inde- 
pendently organized, largely serve the military, com- 
mercial school and on-the-job trainees. They are spon- 
sored by the American Medical Technologists and the 
International Society of Clinical Laborato ry Tech- 
nologists. 

!t was not the purpose of the Manpower Adminis- 
tration to provide a new way to certification by a 
professional group for those who lacked this credential, 
the Proficiency Examinations stand on their own as a 
tool for Job placement without such a tie-in. But as 
pointed out from the start by members of the 
Subcommittee on Utilization, understanding and use of 
the Examinations by employers would be increased if 
the tests were in some way related to existing 
credentialing systems. NCCML has therefore presented 
this possibility to the appropriate bodies. 

No relationship between the Proficiency Examina- 
tions and the certification system has been achieved. Yet 
the existence of the Examinations has served to 
encourage provision of alternate pathways for cer- 
tification of experienced laboratory workers who lack 
formal training requirements but who can prove they 
have the necessary job knowledge and capabilities. 

The Board of Directors of the American Society of 



(We recomn-iend) that employers, both 
private and public, hire and promote 
on the basis of talent alone as well as 
on prior certification. This will re- 
quire better tests of talent, more 
exercise of individual judgment by 
employers and their representatives, 
more training opportunities on the job, 
and more concern for ladders to rise 
and less with ceilings based on prior 
certification. The best test is per- 
formance on the job. . . . Greater 
reliance by employers on tests de- 
veloped to screen applicants for posi- 
tions would be vastly less costly to 

society. . . . 

"Less Time, More Options, Carnegie 
Commission on Higher Education (1971) 



Professional associations and licensing and 
credentialing bodies should remove unneces- 
sary, purely fornuilistic obstacles from the 
paths of those striving to progress from 
lower to higher levels of knowledge and 
skill within the same general specialty area. 
Adequate account should be taken of what 
has been learned through non-traditional 
educational forms and by experience. . . . 

-AMA Council on Medical 
Education (1973) 



Clinical Pathologists instructed its Board of Registry in 
August 1971 "to explore the possibility of using 
proficiency examinations and equivalency examinations 
to qualify personnel to take Registry examinations." 
The Board of Registry and the CLA and MLT 
Committees have discussed such use of the Proficiency 
Examinations for Clinical Laboratory Personnel on 
several occasions. 

A major problem in relating the Proficiency Ex- 
aminations to ASCP certification appears to be the level 
of the tests. The Examinations were designed to 
"evaluate the Job-related skills and knowledge necessary 
for a laboratory technician" within a rather wide range 
above the assistant level and below that of the Medical 
Technologist, as discussed earlier. This is the level where 
the tests can be most useful in their prime purpose of 
identifying skills of former military laboratory specialists 
and experienced civilians trained on the Job. 

While they thus would appear to relate to the Job 
level of the MLT(ASCP), there is a two-year college 
requirement for certification at that level which ^either 
the Board of Registry nor the MLT Committee wishes to 
waive or supersede at this time. The Board of Registry 
was willii^ in July 1972 to accept an experimental trial 
of the Examinations in lieu of the laboratory training 
componem of MLT(ASCP) eligibility, but the MLT 
Committee did not concur, and the matter was dropped. 

The possibility of relating the Proficiency Examina- 
tions to the Certified Laboratory Assistant level has been 
discussed during the past two years. This level of 
certification is already available to former military 
corpsmen, but there has been no alternative to formal 
CLA training for civilian laboratory workers wishing to 
qualify. The Board of Registry in July 1972 voted to 
open the CLA(ASCP) examination to candidates lacking 
« 
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The Department encourages the develop- 
ment of meaningful equivalency and 
proficiency examinations in appropriate 
categories of health personnel for 
entry into educational programs and 
occupational positions. The States are 
called upon to assist in the imple- 
mentation of this effort by amending 
licensing laws, where necessary, that 
will recognize such examinations for 
purposes of granting advanced edu- 
cational or job placement 

--HEW heport on Licensure and 
Related Health Personnel Credentlallng 

n971) 



formal training requirements who could meet acceptable 
scores on all four Proficiency Examinations. Announce- 
ment of this decision produced considerable interest 
among civilian laboratory personnel. 

NCCML and ETS made available to the Board and the 
CLA Committee the Examination scores of several 
hundred candidates who could be identified as CLA's. 
Many of them had not taken all four tests^ however, and 
removing these from the list resulted in very small 
populations from which to make statistical gen* 
eralizations. The average scores of these CLA^s who took 
all four Proficiency Examinations were as follows: 



Form A FormB 

f57 candidates } { 71 candidates ) 
Clinical Chemistry 20 24.0 
Microbiology 28.5 28.7 
Hematology 41.1 40.8 
Blood Banking 26.S 29.0 



NCCML and ETS also arranged for the CLA 
Committee members to review the test booklets at their 
meeting in July 1973. Comments indicated there was 
need for updating (a subject which will be treated in a 
subsequent section of this report), and that some areas 
covered by the tests are not included in some CLA 
training programs. The Committee agreed to study 
various alternate pathways to CLA(ASCP) certification 
in order to recommend a more flexible approach to the 
Board of Registry for its approval. 

Thus while NCCML failed in efforts to gain a formal 
tie*ln of the Proficiency Examinations with the cer* 



tiilcation system, there is promise for adoption of some 
other method to recognize experienced laboratory 
workers, at least at the lowest level. 



Licensure 

Ten states, Puerto Rico, and the City of New York 
now license laboratory personnel below the level of the 
director. Several states include standards for personnel in 
their regulations for licensing clinical laboratories. The 
effect generally is the same: to require certain education 
and experience of anyone wishing to work in a 
laboratory. Legislation affecting laboratory personnel 
standards is perennially under consideration in other 
states, but has been curtailed for several years following 
a call by the American Medical Association and the 
American Hospital Association for a moratorium on 
additional licensure. 

That moratorium was endorsed by Elliot L. 
Richardson, then Secretary of Health, Education, and 
Welfare, in his August 1971 "Report on Licensure and 
Related Health Personnel Credentialing.'' In that hiflu* 
ential report. Secretary Richardson said HEW "en* 
courages the development of meaningful equivalency 
and proficiency examinations in appropriate categories 
of health personnel for entry into educational programs 
and occupational positions.** The report recommended 
that state licensing bodies use such examinations as an 
alternative to education or experience requirements. 

A similar recommendation was made in a 1972 report 
on "Occupational Licensing and Public Policy,** pre* 
pared for the Manpower Administration and later 
published by Public Affairs Press. Principal author of 
this report was Benjamin Shimberg, director of occupa* 
tional programs for Educational Testing Service. The 
report credits NCCML with helping "to create a cUmate 
favorable to equivalency and proficiency testing** in the 
health Held. 

NCCML has kept slate licensing agencies informed 
during development of the Proflciency Examinations for 
Clinical Laboratory Personnel. Several such agencies 
have shown interest in using the Examinations in their 
licensing processes. 

Tennessee was the flrst to make use of the 
Proflciency Examinations, originally for ex*militafy 
corpsmen and later for all experienced laboratory 
workers seeking to qualify for technician licensing in the 
State. The Laboratory Licensing Service announced in 
February 1973 that candidates may qualify for the 
State*s technician licensing examinations in any of the 
four fields in which they take the Proflciency Examina* 
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tions and meet the average score of NCCML's nornting 
groups. The Service has arranged to administer tlie 
Examinations for this purpose three times a year, under 
ETS direction, for the convenience of prospective 
licensees. 

Nevada's Bureau of Laboratories and Research in- 
formed NCCML in December 1973 that its Advisory 
Committee is in favor of adopting the Proficiency 
Examinations "as a means of qualifying technologists for 
certification in Nevada." 

The Montana Department of Health and Environ- 
mental Sciences is committed to using the Examinations 
in lieu of develo^ring their own tests under licensure 
legislation now pending. 

Licensing committees in New York City and in 
Georgia have asked to review the Examinations, and 
arrangements have been made for them to do so. The 
Laboratory Advisory Committee in Hawaii has expressed 
interest in use of the Proficiency Examinations. Pennsyl- 
vania, Michigan and Florida officials have also inquired 
about use of the Examinations in licensing laboratories 
and workers. 

Civil Service 

Federal, state and local civil service agencies may 
consider use of the Proficiency Examinations to qualify 
personnel. 

Under Federal regulations, higher level positions are 
open only to those with formal training and experience 
requirements. A military laboratory specialist coming 
from a supervisory position in an Armed Forces 
laboratory cannot obtain a similar position in the U.S. 
Civil Service laboratory system. 



As director of a clinical laboratory, 
I endorse this concept of proficiency 
testing for Individuals who receive 
laboratory technician training In 
other than the AMA-approved tech- 
nician and technologists programs. We 
may well decide to require such testing 
of job applicants for these positions 
if they have not had the formal aca- 
demic training in these fields. 

-MICHAEL L O'CONNOR, M.O., 
The University of Iowa (1972) 



The evidence continues to mount-In the 
health fields and in general education-to the 
point that In almost every area the question 
is not whether proficiency and equivalency 
measurements can be made, but how sincere 
you are In really wanting to do the job. 

-Pathways to Health Careers, Health 
Careers Council of Illinois (1972) 



Officials of the Standards Division of the U.S. Civil 
Service Commission have said Proficiency Examinations 
scores could be used within present regulations. Ac- 
cording to Leon H. Blumenthal, Chief of the Science and 
Engineering Occupations Section, "The results of such 
examinations would be u useful measure of the 
qualifications of candidates for clinical laboratory 
positions." 

State and local civil service agencies have been 
informed of the Proficiency Examinations by the Bureau 
oi Intergovernmental Personnel Programs of the U.S. 
Civil Service Commission, which recommended to 
regional and state offices: 

We think that the professional groups 
supporting this endeavor are to be com- 
mended for promoting this innovative but 
sound alternative to an absolute educational 
requirement as the basis for entry to higher 
level laboratory positions. It occurs to us 
that you mi^u find this testing program 
useful in one or more of several ways, such 
as an alternative way of meeting minimum 
qualifications, a rated part of an examina- 
tion, or a significant part of qualifications 
evidence provided to appointing officials. 

NCCML has informed agencies of this possibility, but 
has not pursued it individually with any of them. 

Medicare 

For reimbursement under the Medicare program, 
providers of health services must meet various Federal 
requirements. Among these are regulations establishing 
certain standards or qualifications for health care 
personnel. 

In the case of clinical laboratories, three different sets 
of regulations pertain. Hospitals accredited by the Joint 
Commission on the Accreditation of Hospitals (JCAH) 
are presently accepted for Medicare reimbursement, and 
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EXHIBIT K: 

Norming Data for Medicare 

The following data summarize the preformanoe of 1,061 
Me(Jloare*quallfled laboratory teohnlolans on the Proflolenoy 
Examinations for Cllnloal Laboratory Personnel. 

Form A was given In July 1971, November 1971 and Decem- 
ber 1972. Of 465 candidates whose scores are summarized 
belowi 114 were CLA*tralned (qualifying under Section 
405:1315(dMlM and 351 were military-trained (qualifying 
under 405:131 5<d)<3}). 

Form B was given In July 1971 and May 1972. Of 598 candi- 
dates whose scores are summarized below, 232 were CLA* 
trained and 364 were mllltary*tralned. 



Form A Form B 

CLINICAL CHEMISTRY 

Number 376 507 

CLA*tralned 71 210 

Mllltary*tralned 305 297 

Mean 34.39 29.14 

Standard Deviation 1 3.08 1 1 .25 

MICROBIOLOGY 

Number 365 479 

CLA-tralned 70 19! 

Mllltarytralned 295 288 

Mean 42.97 35.46 

Standard Deviation 14.94 14.54 

HEMATOLOGY 

Number 415 546 

CLA-trained 92 229 

Military-trained 323 317 

Mean 44.76 43.14 

Standard Deviation 11.13 9.75 

I 

BLOOD BANKING 

Number 368 486 

CLA-trained 80 206 

Milltarytrained 288 280 

Mean 34.54 32.55 

Standard Deviation 13.77 12.01 



the JCAH standards for laboratory personnel do not 
spell out detailed educational or experience qualifica* 
tlons. Other hospitals are.directly regulated by Medicare, 
again, with no speciHc rules regarding the qualifications 
of laboratory personnel. Nearly 2,500 independent 
clinical laboratories, however, come under a third set of 
Medicare regulations which do specify certain education 
and experience for laboratory technologists and tech* 
nicians. There is pressure to extend these independent 
laboratory regulations to hospitals,but this has not been 
done to date. 

Since an initial impetus for the Proficiency Examina- 
tions Project was the interest of the House Ways and 
Means Committee in providing alternate ways for 
laboratory technicians to quaUfy under Medicare's 
personnel standards for independent laboratories, 
NCCML has kept in touch throughout the project with 
the HEW Division of Medical Care Standards, the offlce 
charged with developing those standards. Division staff 
members attended the meeting of the project's Sub- 
committee on Utilization and several meetings of the 
National Advisory Committee. Special meetings with 
Division staff have been held to keep them informed on 
the status of the project. 

Meanwhile, mandates for Medicare to use proflciency 
examinations as an alternate way to quaUfy laboratory 
personnel have grown from interest on the part of the 
Ways and Means Committee into a requirement of law. 

In 1970, the Committee asked the Division of 
Medical Care Standards to consult ''with appropriate 
professional health organizations and education institu- 
tions to develop proHciency testing and educational 
equivalency mechanisms for use in determining the 
qualiflcations of laboratory personnel under the 
Medicare program.** The Division reported in 1971 on 
both developing testing projects, and indicated that ''the 
proficiency examinations . . . have more immediate 
potential for application to the Medicare program " 

In new regulations for independent laboratories it 
drafted in 1970, the Division included a provision 
whereby those technical personnel who do not meet 
formal training and experience requirements may prove 
they are qualified if they ' successfully participate in 
proficiency and/or equivalency examinations when these 
examinations are available and approved by the Sec- 
retary." Althougi) these regulations have not yet been 
adopted, for a number of reasons unrelated to this 
report, there has been no question about that new 
section providing workers with alternate ways of 
qualifying. 

Congress gave the mandate the force of law in H.R. 1, 
the Social Security Amendments of 1972 (P.L. 92-603), 



directing HEW to provide - uniti December 31, 1977 - 
proficiency examinations as an alternate qualifying 
mechanism for ail categories of health personnel 
regulated under Medicare. HEW is now having a whole 
series of proficiency examinations developed to meet 
this requirement, including tests for clinical laboratory 
technologists and cytotechnologists. These projects are 
outlined in a subsequent section of this report. 
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Meanwhile, Proflciency Exanunations for Clinical 
Laboratory Personnel - for laboratory technicians - 
now exist. NCCML and ETS and the HEW Division of 
Medical Care Standards have met and corresponded for 
more than a year in an effort to establish whether these 
NCCML Examinations are appropriate for Medicare 
purposes in qualifying laboratory technicians as required 
under P.L 92^603. To date, no decisi'^n has been made. 

Last spring, it was agreed that the Division would 
convene an outside panel to advise on the appro* 
priateness of NCCML's Proficiency Examinations for its 
purpose. For this panel, the Dii^sion requested a 
statement on how the Examinations were developed, 
along with appropriate norming data vis*a*vis Medicare 
standards. NCCML and ETS compiled this information 
in July 1973 in the form of a 52-page memorandum 
including details of test development procedure, lists of 
laboratory experts involved, content outlines, and other 
test speciflcations. Also included were analyses of the 
test scores of 1,061 candidates who qualify under 
Medicare's present regulations for laboratory "tech* 
nicians." Of these candidates, 346 were qualified under 
Section 405:1 31 5(dKl), through training as Certified 
Laboratory Assistants. The other 715 qualified under 
Section 405:131S(d)(3), as trained and experience 
military laboratory specialists. Their scores are shown in 
Exhibit K. 

The Division also requested that the tests themselves 
be made available for review at a meeting of the advisory 
panel. ETS has arranged to make this possible. Both 
NCCML and ETS have also indicated willingness to 
invite as resource persons for that meeting testing 
experts, members of the Examining Committees, or 
members of the project's National Advisory Committee, 
as the Division staff thinks appropriate. 

The Division has not yet convened an advisory panel. 
Division staff have met with the Manpower Adminis- 
tration project officer to discuss the legalities of a 
request from HEW to DOL for use of the Examinations, 
should they be deemed acceptable for Medicare. Federal 
government ownership of the Examinations makes such 
usage possible. 

But the question of Medicare's use of the Proficiency 
Examinations for Clinical Laboratory Personnel as an 
alternate way of qualifying laboratory technicians Is still 
unresolved. 



Special Evaluations 

The Proficiency Examinations can serve numerous 
other Innovative purposes. 
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Leaders of two laboratory training programs are using 
the Examinations as one means of evaluating those 
programs. The University of Alabama is using the tests as 
a measure of student achievement In Its experimental 
HEW-funded technical training project, In which high 
school graduates and students who have completed a 
year of junior college are given a year of laboratory 
training, on completion of which the former are 
CLA*ellglble and the latter receive the AD*MLT from 
their colleges. 

At the Lakeshore Medical Laboratory Training 
Programs In Michigan City, Indiana, Educational Coor- 
dinator Ellen Flrme, MT(ASCP), has had CLA students 
take the Proficiency Examinations, and Is now using the 
Examinations as a pre-test In a new special program 
training experienced but uncredentlaled workers as 
CLA's. 

The tests can also be used as a diagnostic tool to 
Identify Individual needs of laboratory workers for 
continuing education. NCCML Is trying this approach In 
Its Labor Department-sponsored program to upgrade the 
skills of laboratory workers In Indian Health Service 
hospitals In Arizona. Workers participating In the project 
have taken the Proficiency Examinations In a specially- 
arranged administration, and Individualized study and 
tutorial programs have been designed for each of them 
based on their scores. The materials used In this 
continuing education project are a comprehensive set of 



One thing the Proficiency Examinations 
scores have accomplished is to show that the 
military are better lab technicians than 
they thought they were, that they are 
superior In many areas. Any lab worker, 
military or civilian, by taking the Proficiency 
Examinations can discover where his 
strengths and weaknesses lie. In hiring, I 
always look first at references from former 
employers for professional experience and 
ability to get along with people, but I also 
like to see Proficiency Examinations 
scores as a part of a general evaluation. 

-ROBERT REID, Hematology 
Supervisor, Washington (O.C.) 
Hospital Center (1972) 
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I encourage all competent technicians 
to take the Proficiency Examinations 
because any good scores on their 
record are a plus, especially for 
those trained on the job and with no 
professional certification. 

-PRISCILLA CARLSON, Hematology 
Supervisor, Suburban Hospital, 
Bethesda, Md (1972) 



I am in complete accord with the con- 
cept of career mobility and believe 

that the Proficiency Examinations will 
be very useful to me in this regard. 

-JOHN G. ETHERIDGE, M.D. 
Coliseum Park Hospital, Macon, Qa. 

0974) 



I saw one of your bulletins and had to 
write you and sing your praises. I 
have personally wished for something 
on this order for years. 

-JANE SABES, MT(ASCP), Chief Lab 
Tech, Johnson County Memorial 
Hospital, Cleburne, Texas 0972) 



This seems to me to be the way to 
provide upward mobility for laboratory 
workers, which is a very desirable 
thing to have. 

-HELEN KITTSLEY, Assistant to 
the Dean, University of Wisconsin- 
Milwaukee (1972) 



I think this is a grand opportunity for 
those caught in the "education gap." 

-DOROTHY MILLER, M.T., St. Luke's 
Hospital Laboratory, Bethlehem. 

Pa. {1973( 



audio-taped lectures with slides called '^Listen, Look and 
Learn," also developed by NCCML under contract with 
the Labor Department. 

State health departments and voluntary agencies 
interested in improving laboratory performance in a 
number of other areas have begun making plans for 
similar use of the Proficiency Examinations in their own 
continuing education projects. 

The Proficiency Examinations can have a role in 
rehabilitation of prisoners. MDTA-supported laboratory 
training is available in the Federal Bureau of Prisons' 
Medical Center in Springfield* Mo.» and inmates there 
have taken the Proficiency Examinations. In cooperation 
with the training director at Springfield, NCCML has 
attempted to assist in finding job opportunities for 
several of these trainees about to be paroled, but the 
tightening of the job market has made this difficult to 
achieve. 

There are other laboratory workers in prison hospitals 
arouv'd the country who have been trained on the job, 
and under the newly-enacted Comprehensive Employ- 
n.ent and Training Act of 1973, it may be possible that 
payment of test fees can be authorized either under Title 
f. Sec. 101, or Title III Sec. 301. 

Another possible use of the Proficiency E?(aminations 
is to measure the job competency of foreign^trained 
laboratory workers who wish to come to the United 
States to work. A graduate in medical technology from a 
foreign university is not eligible to become a certified 
medical technologist in this country unless he takes a 
year-long course in an AMA-approved school. To apply 
to sucn a school, he must have Board of Schools 
approval of his college transcript, and then must find a 
school willing to accept him. Most schools of medical 
technology today have more applicants than they can 
accept, and they can fill their classes without taking on 
the extra problems that accepting a foreigner may entail. 

Those wanting to come from abroad might find job 
placement here through the Proficiency Examinations 
route - if their English is sufficient for a paper-and- 
pencil test. While ETS can only arrange a test center 
overseas for military laboratory specialists, once such a 
center is set up on a military base it will also accept 
civilians who wish to take the tests. NCCML has had 
considerable correspondence with foreign laboratory 
workers, particularly in the Far East, about this. 

While the present job scarcity in some areas of the 
country makes tliis opportunity less hopeful for foreign- 
trained laboratory workers today, it could nonetheless 
be a possibility for the future. 



Follow-up Study 



Roficiency examinations provide "a short circuit to 
advance deserving workers lacking the necessary educa- 
tional qualifications up through the ranks without 
professional accreditation " 

Reactions like this one from Dr. Simon Russi, 
director of laboratories at Petersburg (Va.) General 
Hospital, from other employers and supervisors, and 
from laboratory workers themselves, came in a survey 
made after the first examinations. 

Dr. Russi gave raises to three technicians after the 
examinations. 

''Because I teach at the Medical College of Virginia, 1 
am able to evaluate their capabdities myself," Dr. Russi 
explains. "But as an administrator, I need an outside 
yardstick. The proficiency examinations have provided 
me with such an objective conformation." 

Sharon Foreman at Prince Georges General Hospital 
in Maryland worked for eight years without academic 
credentials before taking the Blood Banking and 
Hematology proficiency exams. 

"I showed my scores to my supervisor who was 
sufficiently impressed to give me a merit raise and I am 
now Blood Bank Supervisor," she reports. "1 think the 
proficiency exams are dohig a terrific job in helping 
people get ahead on the basis of their job experience." 

M/Sgt. Gerald W. King is in the Chemistry Section of 
Andrews Air Force Base Clinical Laboratory. He took all 
four tests in May 1972. 

"When I get out of the Air Force," he said later, "1 
hope to put the scores to use in getting a civilian job/* 

Martha DeMarcky, chief medical technologist at 
Dover, N.J., General Hospital, encouraged three of her 
laboratory workers who had been trained on the job to 
take the proficiency tests. 

"Our girls did very well," she reports. "All three 
attend college, and their good scores gave them renewed 
self*confidence to continue toward their degrees. As for 
us, we were glad to have the assurance that our training 
was measuring up»" 
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The Proficiency Examinations must prove themselves 
In practice as useful tools in making employment 
decisions. 

To gain an understanding of the actual employment 
experiences of some of the candidates who had taken 
the tests, NCCML and ETS conducted a telephone 
follow-up study of candidates who took the Examina- 
tions in the pilot 1971-72 year, asking why they did so, 
what they thought of the tests, and what if any result 
they had achieved through use of their scores. 

The survey confirmed expectations. The average 
candidate had taken the tests out of curiosity ("just tc 
see how I would measure up"); thouglit they were good 
tests, if somewhat difficult; and didn't do anything with 
the scores. 

Specifically, the results of the survey were as follows: 

A total of 277 candidates living in California, the 
District of Columbia, Illinois, Indiana, Iowa, Maryland, 
Michigan, New Jersey, New York, Pennsylvania and 
Virginia were interviewed. Many others were no longer 
at the same address less than a year later. Some may 
have been in the military. 

Of those who cited reasons for taking the test, 154 
(58.3%) indicated curiosity, 49 (18.5%) sakl a supervisor 
or Instructor had asked or suggested they take the tests, 
and 61 (23. 1%) did so with a hope of upgrading, now or 
in the future. Some few were under the mistaken 
in^resslon these tests were soon to be required, so they 
might as well get it over with. Another handful thought 
they would gain academic credit by taking them. Others 
were in training or retraining programs and wanted to 
assess their progress, or to have some practice for a 
forthcoming certifying examination. Some were super- 
visors who were urging others to take the tests and so 
became candidates themselves in order to know what the 
tests contained. 

Comments <m the tests themselves were generally 
favorable. Asked what they thought of the tests, 173 
(84.4%) expressed positive ophiions (of these, 23 were 
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I urged some of my students pre- 
paring for the Registry exam In 
Medical Technology to take the Pro- 
ficiency Examinations. They then 
studied especially hard In the areas 
where the Exams showed up their 
weaknesses, and they all passed the 
Registry exam. 



-JAY M. PRICE, VA Hospital, 
Washington, D.C. (1972) 



The scores of the lab technician here 
who took two of the Proficiency Exam- 
inations have been made a part of her 
permanent record. When a personnel 
salary review comes up they will be 
a valuable measure of her capabil- 
ities and will certainly be taken 
Into consideration. 

-JAMES M. HARDEE, MT(ASCP), 
Administrative Officer, Hunter 
Laboratories, Washington, D.C. (1972) 



classified by the pollers as "extremely positive"), and 32 
(15.6%) expressed negative opinions. While 68 found the 
tests difficult and 18 found them easy, there was no 
attempt to correlate these opinions witJi job experience 
or test scor^$, . Some few felt the tests were too 
theoretical; others said they were too practical, and 
ability to answer would depend on the type and size lab 
one worked in. 

Consistent with their "just to see" purpose in taking 
the tests, most candidates - 1 22 (59.5%) - didn't try to 
do anything with their scores. Of the 83 (40.5%) who 
did show the scores to a supervisor, 61 received no 
response at all. The "positive" responses of the other 23 
supervisors ranged from a smile to a pat on the back to a 
few promotions and raises. Comments pointed up the 
need for more information both for employers and 
employees. It was clear that while many supervisors may 
have urged their employees to take the Proficiency 
Examinations, many others had never heard of the tests 
or had no idea what to make of the scores. Candidates 
themselves were confused about what their scores 
meant, and NCCML's subsequent efforts to present the 
normlng information bore that in mind. 

Presumably, shnilar interviews with candidates who 
paid to take the tests might reveal a different pattern of 
purposes and results. Attempts were later made to reach 
December 1972 candidates in the same geographic 
locations, but the number of telephone contacts was 
very small. Of 24 interviewed, 9 took the tests out of 
curiosity, 8 because of a supervisor's recommendation, 
and 7 with the hope of upgrading. Fifteen commented 
positively about the tests, and only one negatively. Ten 
had done nothing with their scores; of 13 who had 
showed the scores to a supervisor, only three had a 
positive response. Thus while the candidates' purposes 
seemed to have changed with the imposition of a $25 
fee, the opinion of the tests continued to be favorable, 
and it was still evident that there was no certainty as to 
what could be achieved with the test scores. 

This telephone survey was originally conceived as a 
trial run for a more thorough questionaire follow-up of 
all candidates and their supervisors, correlating both 
opinions and individuals* progress up the career ladder 
with the test scores and other variables. When it was 
learned that few candidates could yet point to objective 
results from taking the tests, despite their favorable 
attitude toward them, the decision was made to 
concentrate efforts on filling the need for information 
instead. A comprehensive follow-up study could be very 
enlightening. 



44 



ERIC 



Equal Employment Mandates 



A. new impetus for use of job*related proficiency 
examinations to qualify workers for employment in all 
fields is the current national movement for equal job 
opportunity. Court decisions and Federal, state and local 
l»\vs have outlawed discrimination in employment on 
account of race, colorTTeligion, sex, or national origin. 
All employment practices are now under scrutiny to see 
whether they in fact have the effect of discriminating, 
whatever their intention. 

Requirements for selection and promotion of per* 
sonnel have come under successful attack in the courts. 
In the landmark case, Griggs v. Duke Power Co., the 
Supreme Court ruled that employers who rely on 
intelligence and aptitude tests - or, by implication, on 
high school diplomas or other academic qualifications - 
may be guilty of discrimination under the 1964 Civil 
Ri^ts Act, unless they can prove their requirements are 
specifically related to job performance. Chief Justice 
Warren Burger, writing the Court's unanimous opinion. 



said employers must **measure the person for the job 
and not the person in the abstract.'' 

Several sets of Federal rules for assuring that 
employment tests are job-relateo have been pro* 
mulgated. They are now being revised into a uniform set 
of regulations which will apply under all the various 
Federal mandates prohibitbig discrimination in em* 
ployment. 

The Proficiency Examinations for Clinical Laboratory 
Personnel were carefully designed to test the skills and 
knowledge necessary to perform the functions of a 
laboratory technician. The opinion of those who have 
seen the tests is that they appear to do just that. But it 
remains to be proven that higher scores on the 
Proficiency Exaniinations correlate with better per- 
formance on the job. Such a study should be under* 
taken, using sophisticated techniques, to assure that 
these Examinations can provide the useful tool for 
employers it was intended they should be. 



. . . Properly validated and standardized employee selec- 
tion procedures can significantly contribute to the 
implementation of nondiscriminatory personnel policies. 
. . . Professionally developed tests, when used In con- 
junction with other tools of personnel assessment and 
complemented by sound programs of job design, may 
significantly aid In the development and maintenance of 
an efficient work force and, Indeed, aid in the utilization 
and conservation of human resources generally. 

-^Guidelines on Employee Selection Procedures, 
Equal Employment Opportunity Commission 
0970) 
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Other Allied Health Fields 



ihe model established by NCCML and the Labor 
Department in developing proficiency examinations has 
now been followed in other allied health fields. 

In a speech before a subconm^ttee of the DOL 
National Manpower Advisory Committee in June 1972, 
Thomas J. Hatch, director of the HEW Division of Allied 
Health Manpower, applauded the Manpower Admin- 
istration for leading the way in the complex and difficult 
effort to determine what constitutes proficiency in a 
health occupation. Credentialing, he said, ''acts as a 
barrier to career development for substantial numbers of 
persons, many of whom are presumed to be competent 
in their field/' 

HEW has begun a number of proficiency examina- 
tions projects, working with a*-ied health organizations 
and testing agencies, and stimulated by two 
Congressional mandates. 

In the Health Training Improvement Act of 1970 
(P.L. 91-519), HEW was authorized to develop pro- 
ficiency examinations to recognize previously acquired 
training or experience in the allied health fields. And in 
P.L. 92-603, the Social Security Amendments of 1972, 
HEW was directed to provide proficiency examinations 
as an alternate qualifying mechanism for health per- 
sonnel regulated under Medicate. 

The Division of Allied Health Manpower, with 
responsibility under the former law, and the Division of 
Medical Care Standards, with responsibility under the 
latter, worked out an agreement to coordinate efforts 
and avoiJ duplication in developing and administering 
tests for workers ''seeking recognition of their com- 
petence to practice for purposes of meeting employment 
requirements, professional recognition, and/or partici- 
pation in government-sponsored reimbursement pro- 
grams.'' 

The two Divisions agreed that development of such 
proficiency examinations should generally proceed in 
three phases: ''(1) preparation of the framework of 
essential knowledge and skills related to performance 



requirements, (2) development of appropriate tests and 
procedures applicable to job levels within the discipline, 
and (3) administering such tests to individuals seeking 
recognition of their competence. ..." 

Proficiency examhiations projects for allied health 
workers are in various stages. Those contracted with the 
Division of Allied Health Manpower are as follows: 

1. Physician Assistant A test prepared by the 
National Board of Medical Examiners was given in a 
norming administration in December 1973 to candi- 
dates who have graduated from formal training 
programs. Eligibility for future administrations will 
be broadened to include those trained oiUhe job. 

2. Occupational Thempy. Follovi^iiiif a phase I 
contract in which the American Occupational 
Therapy Association developed skills and knowledge 
requirements, the Professional Examination Service 
of New York City is developing tests for two levels 
comparable to the assistant and the therapist. 
Completion is expected by summer. 

3. Radiologic Technologist ITechnician. Educa- 
tional Testing Service, contractor for both of the first 
two phases, is now pretesting an examination 
expected to be ready by summer. 

4. Respiratory Therapy. Following a phase I 
contract with the American Association of Res- 
piratory Therapy, the Psychological Corporation of 
New York City is developing tests for two levels 
comparable to the technician and the therapist. 
Completion is expected by summer. 

5. Medical Record Personnel The American 
Medical Record Association is at work on phase I, 
expected to be completed by the end of 1974, after 
which bids will be sought for test development. 

The Division of Medical Care Standards is sponsoring 
contracts in the following fields: 

6. Clinical Laboratory Technologist Professional 
Examination Service has contracted for phases 1 and 
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2) and a completed examination is expected to be 
ready by the end of 1974. 

7. Cytotechnolog^sl Professional Examination 
Service has contracted for phases 1 and 2, and a 
completed examination is expected to be ready by 
the end of 1974. 

8. Licensed Practical Nurse. The National League 
for Nursing has developed a test for waivered LPN's. 
It was given to 2,260 candidates in September 1973, 
and preparations are being made for 10,000 candi* 
dates for the second administration this April. 

9. Physical Therapist. A test to qualify state 
licensed physical therapists without full professional 
training for Medicare participation was developed in 
1970 by Cybern Education Inc. The test is being 



administered annually by the Psychological Cor- 
poration; there were 59 candidates in December 
1973. 

One additional proficiency testing project is under* 
way through the HEW Division of Health Services Design 
and Development, a research project unrelated to the 
mandates described above: 

10. Emergency Medical Technicians. The Uni- 
versity of Alabama School of Community and Allied 
Health Resources has developed a proficiency 
examination which ultimately could be useful in 
licensing and certification of emergency 4nedical 
technicians. The project is now gathering normative 
information and doing statistical analyses. 



Future Needs 



Xhree problems regardhig the Proficiency Examlna* 
tions for Clinical laboratory Personnel remain as 
Contract #82*22*70*35 draws to its close: 

1. The Examinations will soon need to be 
updated, since the clinical laboratory field is an 
ever*changing one. 

2. ft is not possible for candidates' fees to cover 
more than the cost of administering and scoring the 
tests. Thus there is no provision for publicizing the 
Examinations in the future. 

3. A study to compare job performance with test 
scores will be necessary to prove the Examinations 
are job-related under the mandates of equal em* 
ployment opportunity regulations. 

Two possibilities for accomplishing these ends re* 
main. 



One lies in the intention of Medicare officials to ask 
an advisory panel to rule on the possible use of the 
Proficiency Examinations to qualify laboratory tech* 
nicians under Medicare regulations, as required by P.L. 
93*603. An affirmative decision would necessarily 
commit Medicare to update the Examinations and 
publicize their availability. And proof of the job* 
relatedness of Medicare's examinations is certain to be 
required in the future. 

Another opportunity lies in the recent decision of the 
Board of Directors of the American Society of Clinical 
Pathologists that the Society should seek to do a study 
of the job*relatedness of the Proficiency Examinations 
for Clinical Laboratory Personnel. Such an interest 
might lead to a related interest in updating and 
promoting the Examinations. 
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